Senior System Software Engineer - AI Performance and Efficiency Tools at NVIDIA

Department: Engineer, Sys SW

Language

Setup: On-site
Location: Huangpu, Shanghai
Type: Full-time
Level: senior
Posted: May 20, 2026

Description

NVIDIA is hiring a Software Engineer to develop profiling, debugging, benchmarking, and simulation tools for AI workloads running on large-scale GPU clusters. The role partners with architecture and software teams to improve workload insight, performance, power efficiency, and reliability, and requires strong C++ and Python software skills, knowledge of deep learning frameworks and GPU infrastructure, and experience with NVIDIA GPUs, CUDA, and NCCL.

Required Skills

C++
Python
PyTorch
TensorFlow
CUDA Programming
NCCL
Slurm
Kubernetes
Linux device drivers

Additional Information

Minimum Education: Bachelor's degree or higher in Computer Science or a related field, or equivalent experience
Required Previous Experiences: 5+ years of software development experience
Experience with NVIDIA GPUs, CUDA Programming, and NCCL
Experience developing GPU cluster-scale continuous profiling and analysis tools or platforms
Experience analyzing performance of large AI training and inference workloads
Preferred Qualifications: Knowledge of Linux device drivers and/or compiler implementation
Knowledge of GPU and/or CPU architecture and general computer architecture principles
Translation Company Name: NVIDIA