Description
Lovable is hiring a Data Scientist to own the measurement and improvement of its AI agent. The role focuses on defining agent quality metrics, building evaluation systems and experiment frameworks, using agent traces and telemetry to identify regressions, and translating insights into fixes with the agent engineering team. It requires experience or strong interest in LLM evaluation and observability, along with SQL, Python, applied statistics, experimentation, and A/B testing. The position works closely with engineers and uses technologies including Braintrust, OTEL, BigQuery, PubSub, GCP, and Hex.
