Description
ServiceNow is hiring an Applied Machine Learning Engineer to build the judgement layer of its agent evaluation platform. The role owns rubrics, judges, calibration against human labels, and the methodology for scoring multi-step agent trajectories, with the calibrated signal used to train and optimize agents. Responsibilities include orchestrating large-scale agent evaluations, implementing OpenTelemetry-native observability and tracing, and building stateful enterprise-system simulations. The role requires at least 8 years of production backend or infrastructure experience, strong Python or Go skills, and experience with distributed systems, workflow runtimes, observability internals, concurrent programming, data-intensive pipelines, and gRPC/protobuf interfaces.
