Description
Annapurna Labs is hiring a Low-Level Systems Engineer to build and optimize the software that transfers KV cache and activations across accelerators, servers, and heterogeneous memory on AWS's high-performance network fabric. The role focuses on profiling workloads, identifying bottlenecks, and pushing components toward hardware limits while working across network transport, inference frameworks, and AI/ML infrastructure. Candidates should have strong C/C++ and low-level systems skills, at least three years of professional software development experience, and at least two years of design or architecture experience; prior AI/ML experience is not required. The position is based in Cupertino, California, with a base salary of 165,200 to 223,600 USD annually.
