ML Systems Engineer at ChipAgents

Department: Engineering

Compensation

$150,000 – $350,000/yr

Setup: On-site
Location: San Jose, California
Type: Full-time
Level: senior
Posted: May 28, 2026

Description

ChipAgents is hiring an ML Systems Engineer to optimize large language model inference for its agentic AI platform. The role focuses on low-level systems optimization, including multi-node cluster deployment, inference performance tuning, bottleneck profiling, evaluation harnesses, and production model serving. Candidates should have a degree in computer science, electrical engineering, or a related field, experience with large-scale ML systems and GPU computing, and strong Python, C++, CUDA, and inference-framework expertise. The position offers $150,000 to $350,000 plus equity and benefits.

Required Skills

Python
C++/CUDA
SGLang
vLLM
PyTorch
GPU architecture
Distributed inference
Quantization
Ray

Additional Information

Minimum Education: Bachelor's, master's, or PhD in Computer Science, Electrical Engineering, or a related field, or equivalent experience
Required Previous Experiences: Experience with large-scale ML systems, GPU computing, or high-performance inference optimization
Hands-on experience with SGLang, vLLM, PyTorch, or similar inference frameworks
Experience deploying and optimizing LLMs in production, including model serving, batching, distributed inference, or quantization
Systems-level debugging and profiling across CUDA kernels and application logic
Preferred Qualifications: Familiarity with distributed computing frameworks such as Ray and multi-node training or inference