AI Evaluations Engineer, US Decision Intelligence at Apple

Department: Machine Learning and AI

Compensation · Listed in posting

$184,700 – $277,600

Location: Cupertino, California
Type: Other
Level: senior
Posted: Sep 18, 2026

Description

Apple is hiring an AI Evaluations Engineer to own the end-to-end evaluation pipeline for AI products and agentic workflows. The role will build and operate evaluation frameworks, instrumentation, rubric-based scoring, agent-as-a-judge workflows, release gates, rerun policies, and observability systems; partner with AI and product teams; and help define evaluation standards across Apple’s decision intelligence and AI initiatives.

Required Skills

Python
AI evaluation
Langfuse
SQL
RAG pipelines
CI/CD
LLM observability

Additional Information

Minimum Education: Bachelor's degree in Computer Science or Engineering, or equivalent work experience
Required Previous Experiences: 5+ years of experience in data and AI-related fields
Hands-on experience with AI evaluation techniques
Experience with LLM ecosystems, RAG pipelines, and vector databases
Experience with SQL and a major data analytics platform
Experience with CI/CD or release validation workflows
Experience working with data science teams on LLM insights
Hands-on experience with Langfuse or similar LLM observability tools
Preferred Qualifications: Strong communication and stakeholder leadership skills
Familiarity with embeddings, retrieval algorithms, agents, and vector and graph databases
Experience with distributed systems, asynchronous messaging, agent communication, and caching technologies
Experience working across global teams
Applied knowledge of GenAI, RAG, microservices, recommendation systems, and context engineering
Knowledge of agent evaluation concepts
Advanced degree in a quantitative field
Translation Company Name: Apple

About Apple

Apple

Mac laptops and desktopsCupertino, CA

Discover the innovative world of Apple and shop everything iPhone, iPad, Apple Watch, Mac, and Apple TV, plus explore accessories, entertainment, and expert device support.

Customers and case studies

See customers and case studies