Description
NVIDIA is hiring a Senior System Software Engineer to develop open-source software for GPU-accelerated AI model inference, including disaggregated serving, inference-state management, distributed inference frontends, and high-performance request scheduling across vLLM, SGLang, and TensorRT-LLM. The role requires a master's or PhD or equivalent experience, at least 10 years in computer science or computer engineering, and strong Rust and Python programming and software design skills. The position is hybrid and offers a base salary of 224,000 USD to 356,500 USD for Level 5 and 272,000 USD to 431,250 USD for Level 6, along with equity and benefits.
