Software Engineer, Evaluation Platform / Infra at ThinkingMachines

Department: Core Engineering

Compensation

$300,000 – $350,000/yr

Setup: On-site
Location: San Francisco, California
Type: Full-time
Level: mid
Posted: Aug 31, 2026

Description

Thinking Machines is hiring an AI Evaluation Platform Engineer to design and build a self-serve platform for authoring, running, tracking, and analyzing model evaluations. The role spans Python and Rust backend systems, data pipelines, APIs, distributed infrastructure, versioning, observability, and user-facing applications, while partnering with researchers and cross-functional teams to turn bespoke workflows into reliable, reproducible systems. The position is based in San Francisco, California, with an expected annual salary of $300,000–$350,000 USD and visa sponsorship.

Required Skills

Python
Rust
Data pipelines
Distributed systems
APIs
React
TypeScript
Versioning
Observability

Additional Information

Minimum Education: Bachelor’s degree or equivalent practical experience in computer science, engineering, machine learning, or a related field
Required Previous Experiences: Two years of post-grad work experience as a software engineer or ML engineer, excluding internships
Hands-on experience building or maintaining evaluations, benchmarks, graders, or model-quality systems for large language or multimodal models
Experience with databases, data pipelines, distributed systems, or other data-intensive infrastructure
Experience collaborating with cross-functional partners and subject-matter experts
Preferred Qualifications: Track record building frameworks, SDKs, or developer tools with thoughtful abstractions and strong user experience
Experience with distributed job execution, workflow orchestration, sandboxed environments, or large-scale data processing
Experience building polished interfaces for inspecting complex data, comparing experiments, or debugging model behavior
Familiarity with large language or multimodal model evaluation, including model-based grading, human evaluation, or synthetic data
Experience working closely with researchers to understand workflows and turn evolving needs into durable systems
Experience at a startup or small team building technically complex products end to end