Backend Engineer at Arize AI

Compensation

$125,000 – $225,000/yr

Setup: Remote, Hybrid
Location: San Francisco, California · New York, New York · +1
Type: Full-time
Posted: Sep 29, 2025

Description

Arize AI, a Series C company specializing in AI observability and evaluation, is seeking a Backend Engineer to join their team. The role involves building scalable distributed services for their ML observability platform, primarily using Go, Java, and Python. The engineer will design APIs, optimize backend services, and integrate collection tools for ML and LLM pipelines. The position requires 5+ years of experience with backend systems and expertise in languages like Go, Python, or Java, along with knowledge of cloud platforms and container orchestration.

Required Skills

Go
Python
Java

Additional Information

Required Previous Experiences: 5+ years of experience working with high-performance backend systems.
Preferred Qualifications: Experience with distributed stream processing - Kafka, Gazette, or similar.
Experience with OLAP systems.
Familiarity with system observability tooling like Prometheus.
Working knowledge of Machine Learning and/or Data Science.
First-hand experience working with large language models (LLMs) or developing AI products.

About Arize AI

Arize AI

AI observability and evaluation

Its tools help AI teams understand agent behavior, measure quality, monitor production performance, and improve prompts, models, and workflows. Developers use Phoenix, an open-source platform, to trace AI applications, run evaluations, investigate failures, and improve quality; Arize AX is a managed AI engineering platform for production AI systems.

Open roles: 15
New in 30 days: 2

Who they serve

Arize AI serves developers through Phoenix, which they can run locally or self-host. Arize AI has named customers including Booking.com, Tripadvisor, and PagerDuty.

Customers and case studies

See customers and case studies