Description
Google Cloud is hiring an AI/ML Software Engineer for its Cloud AI Agent Platform team to build and operate high-performance, horizontally scalable APIs and backend infrastructure for generative AI workloads. The role focuses on routing, load balancing, quota management, data-plane mechanisms, TPUs and GPUs, API security, high availability, fault tolerance, and observability across distributed systems. It requires a bachelor’s degree or equivalent practical experience, 8 years of software development experience, and extensive experience in technical leadership, ML infrastructure, systems architecture, and large-scale serving infrastructure.
