Software Engineer at Netflix

Compensation

$466,000 – $750,000/yr

Setup: Remote
Type: Full-time

Description

Netflix is seeking a Software Engineer specializing in Machine Learning Infrastructure to join their Model Runtime team. This role involves designing and implementing scalable infrastructure for various ML models, including reinforcement learning, GenAI workloads, and distributed training. The engineer will optimize across the entire ML stack, evaluate new hardware, and contribute to efficient deployment of AI solutions.

Required Skills

Systems Programming
PyTorch Internals
Large-Scale Distributed Training
Cloud Computing

Additional Information

Required Previous Experiences: Experience in ML systems engineering — building infrastructure for training, fine-tuning, or inference of pre-LLM and post-LLM era models at scale.
Strong systems programming skills with the ability to work across multiple layers of the stack, from high-level ML frameworks down to GPU kernels and memory management
Hands-on experience with PyTorch internals, large-scale distributed training and system-model codesign
Experience with cloud computing providers, preferably AWS
Preferred Qualifications: Deep experience with distributed training at scale (FSDP, parallelism strategies, checkpointing) or LLM post-training (SFT, RLHF, DPO/GRPO)
Inference optimization — vLLM, TensorRT, quantization, continuous batching, KV-cache management
GPU performance profiling and tuning (CUDA, NCCL, Nsight, PyTorch profiler)
Experience with multimodal or diffusion model architectures and generation pipelines
Track record building reusable ML libraries or contributing to open-source ML projects