Description
Deepgram is hiring a Senior Software Engineer - Model Evaluation & AI Systems to build and operate automated evaluation pipelines, harnesses, canaries, and monitoring systems for speech-to-text, text-to-speech, LLM, RAG, agent, and multimodal models. The role defines evaluation methodologies, pass/fail criteria, quality gates, and reproducible test infrastructure, integrates evaluation into CI/CD, and partners with Research, DevOps, and product teams to protect model quality and customer experience.
