Description
NVIDIA is hiring a Software Development Engineer for LLM inference to develop and optimize scalable inference software for TensorRT-LLM. The role involves performance analysis, kernel and runtime implementation, architecture and hardware feedback, and collaboration with software, research, and product teams. Candidates need a master's degree or equivalent experience, at least three years of relevant software development experience, strong Python and C/C++ skills, and experience with deep learning frameworks, LLM inference, and GPU programming.
