Description
NVIDIA is hiring a Senior Software Engineer – AI Inference Performance to improve the latency, throughput, efficiency, and scalability of LLM and VLM inference on GPU-accelerated systems. The role involves end-to-end inference analysis, profiling with NVIDIA Nsight tools, optimizing serving configurations and CUDA kernels, and contributing to open-source inference engines. Candidates need more than six years of relevant experience, strong Python, Rust, and/or C++ skills, CUDA or GPU programming experience, and a BS or MS in a related field. The base salary range is 184,000 USD to 287,500 USD for Level 4 and 224,000 USD to 356,500 USD for Level 5, with equity and benefits.
