Description
Harvey is hiring a Staff Software Engineer for its Model Infrastructure team to lead the design and development of systems powering AI requests. The role focuses on reliable, scalable, observable, and efficient AI inference, including model routing, provider integrations, capacity and failover systems, observability, cost reporting, and infrastructure efficiency. The engineer will partner with AI Research, Product Engineering, Infrastructure, and external model providers while leading cross-functional initiatives and mentoring engineers. The position requires 7+ years of software engineering experience, strong distributed-systems and cloud infrastructure knowledge, and programming skills in Go, Java, Python, Rust, or C++.
