Skip to main content

Engineering Manager, LLM Performance at NVIDIA

Department: Mgmt, Sys SW

Compensation

$224,000 – $431,250/yr

Setup
On-site
Location
California
Type
Full-time
Level
lead/mgmt
Posted

Description

NVIDIA is hiring an Engineering Manager to lead and grow an engineering team focused on accelerating LLM, VLM, and VLA inference software across TensorRT LLM, vLLM, SGLang, and Dynamo. The role combines hands-on technical leadership with software architecture, performance optimization, benchmark tuning, production-quality library development, project planning, and cross-functional coordination. Candidates need advanced technical education, at least seven years of software engineering experience including three years of technical leadership, and expertise in C++ or Python, LLM/VLM inference, and preferably GPU architecture and CUDA. The posting is marked hybrid and offers a base salary of 224,000–356,500 USD for Level 3 and 272,000–431,250 USD for Level 4, plus equity and benefits.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation