Summary from listing
DeepInfra is hiring a Software Engineer to design, develop, test, and operate production inference systems for open-source AI models. The role involves building and optimizing model-serving systems with Python, C++, CUDA, and NCCL; debugging and monitoring production systems; improving performance; and contributing to system design. Candidates should have a bachelor’s or master’s degree in a relevant field, 1–4 years of relevant experience, strong software fundamentals, Python and AI/ML framework experience, and familiarity with Transformers and Diffusers. The base pay range is $150,000–$195,000 per year.
