Description
The Overwatch Observability & Evaluation Engineer will build telemetry, tracing, dashboards, evaluation suites, alerts, service objectives, runbooks, and readiness evidence for Tachyon agent releases. The role focuses on observability and evaluation for LLM-powered applications, agents, tools, and platform services, including production monitoring, AI quality assessment, reliability analysis, and operational documentation. It requires 7+ years of relevant engineering experience, strong Python skills, and familiarity with observability tools, LLM evaluation, RAG, and production operations.
