Engineering Manager, TPU Performance at Google

Seniority in posting: Advanced

Compensation

$207,000 – $300,000/yr

Location: Sunnyvale, California
Type: Full-time
Level: lead/mgmt
Posted: Aug 10, 2026

Description

Google is hiring an Engineering Manager for its Core Machine Learning organization’s TPU Performance team. The role leads software engineers focused on ML training and serving benchmarks, customer launches, performance optimization, algorithmic innovations, and TPU-friendly model co-design. It requires substantial software development, ML infrastructure, technical leadership, and people-management experience, with a stated US salary of $207,000–$300,000 plus a 20% bonus target, equity, and benefits.

Required Skills

ML performance analysis
Benchmarking
Computer architecture
Kernel programming
Compiler optimization
PyTorch
JAX
vLLM

Additional Information

Minimum Education: Bachelor’s degree or equivalent practical experience
Required Previous Experiences: 8 years of software development experience
5 years leading ML design and optimizing ML infrastructure
3 years of technical leadership experience
2 years of people management or team leadership experience
Experience with ML performance analysis, benchmarking, and computer architecture
Preferred Qualifications: Master’s degree or PhD in Engineering, Computer Science, or a related technical field
3 years of experience in a complex, matrixed organization with cross-functional or cross-business projects
Experience with ML accelerators and low-level kernel programming or tuning
Experience with compiler optimization and ML frameworks or serving libraries
Ability to adapt ML models to hardware strengths and use benchmarking to guide optimization and hardware design