Platform Engineer at Together AI

Compensation

$200,000 – $290,000/yr

Setup: Remote, Hybrid
Location: San Francisco, California
Type: Full-time
Posted: Jun 23, 2026

Description

The Platform Engineer in Model Shaping at Together AI focuses on building and operating foundational layers for their platform, enabling scalable production workflows and internal research experiments. This involves designing, developing, and sustaining backend services and infrastructure, collaborating with various engineering teams, and continuously improving reliability and tooling.

Required Skills

Linux
Kubernetes
Python
Go
Infrastructure Automation
Monitoring/Observability
CI/CD Pipelines
Cloud Environment

Additional Information

Required Previous Experiences: 3+ years of experience in building infrastructure or backend components of production services
Extensive experience designing, operating, and troubleshooting production Linux environments and Kubernetes-based platforms
Preferred Qualifications: Developing large-scale production systems with high reliability requirements
Pipeline orchestration frameworks (e.g., Kubeflow, Argo Workflows, Flyte)
Managing GPU workloads on HPC clusters, ideally with hands-on experience in operating NVIDIA’s networking stack (e.g., NCCL, Mellanox firmware, GPUDirect RDMA)
Deployment of services for AI training or inference
Networking fundamentals, including TCP/IP, DNS, routing, load balancing, TLS, and network debugging tools
Maintaining or contributing to open-source projects