AI Evaluation Engineer at Sage Care

Department: Engineering

Language

Compensation

$200,000 – $250,000/yr

Setup: Hybrid
Location: Jaroměř, Hradec Králové Region
Level: senior
Posted: Mar 18, 2026

Description

Sage Care is hiring an AI Evaluation Engineer to build and operate the intelligence layer of its AI agent platform. The role owns evaluation pipelines, feedback systems, observability and reliability tooling, failure diagnostics, and ML pipelines that convert production conversations into measurable, continuous improvements. It requires 5+ years of software engineering experience, production systems experience, LLM or conversational AI experience, and strong backend engineering and systems-thinking skills.

Required Skills

AI evaluation
Feedback systems
LLMs
Backend engineering
ML pipelines
Observability

Additional Information

Required Previous Experiences: 5+ years of software engineering experience
Experience building production systems
Experience working with LLMs, AI agents, or conversational AI applications
Building AI evaluation platforms or frameworks
Developing feedback systems for ML and LLM applications
Creating observability, reliability, or quality tooling for AI products
Building ML pipelines that improve model or agent performance
Preferred Qualifications: Experience with evaluation frameworks and model quality measurement at AI-native companies
Experience with voice AI systems
Experience designing human-in-the-loop workflows
Experience turning emerging research or new techniques into tested prototypes
Experience building internal platforms used by engineering teams
Experience in healthcare or other regulated, safety-critical domains