Senior Data Scientist specialized in AI Evals at Netflix

Compensation

$372,000 – $600,000/yr

Type: Full-time
Level: Senior

Description

Netflix is looking for an experienced Senior Data Scientist specializing in AI Evaluations to join their Data Science and Engineering (DSE) team. This role focuses on architecting systems and frameworks to measure, validate, and optimize Generative AI (GenAI) systems in production, bridging the gap between model capabilities and end-user experience. The successful candidate will work on both player-facing game experiences and internal agentic tools, aiming to enhance interactive entertainment through AI.

Required Skills

Experimental Design
Causal Inference
A/B Testing
Uncertainty Quantification
Modern AI Evals
Observability Frameworks
LLM and Agentic Systems
Prompt Engineering
RAG Evals
Agentic Evals

Additional Information

Required Previous Experiences: 4+ years of industry experience in Data Science, ML, or AI with strong foundation in experimental design, causal inference, A/B testing, and uncertainty quantification.
Preferred Qualifications: Experience with defining core user experience metrics in gaming or streaming.
Experience working with game development teams, particularly game design and engineering.
Experience with building production-grade ML systems, including MLOps best practices.