Machine Learning Engineer at Inference.net

Compensation

$220,000 – $320,000/yr

Setup: Hybrid
Location: San Francisco, California
Type: Full-time
Posted: Jan 5, 2026

Description

Inference.net is seeking a skilled Machine Learning Engineer to build and improve the core ML systems for their custom model training platform. This role involves leading projects from data intake to trained model, building infrastructure and tooling, and applying cutting-edge ML techniques to achieve frontier-quality AI models at scale. The ideal candidate will have strong experience in training AI models, particularly LLMs, and a passion for turning research into production-ready products.

Required Skills

PyTorch
LLMs
Transformer Architectures
Hugging Face Transformers
DeepSpeed
Axolotl
NVIDIA GPUs
ETL Pipelines
Benchmarking
SFT
RL
Data Processing

Additional Information

Required Previous Experiences: 2+ years of experience training AI models using PyTorch
Hands-on experience with post-training LLMs using SFT or RL
Strong understanding of transformer architectures and how they're trained
Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Axolotl, or similar)
Experience training on NVIDIA GPUs
Strong data processing skills and comfortable building ETL pipelines and working with large datasets
Track record of creating benchmarks and evaluations
Ability to take research techniques and apply them to production systems
Preferred Qualifications: Experience with model distillation or knowledge transfer
Experience building dashboards and data visualization tools
Familiarity with vision encoders and multimodal models
Experience with distributed training at scale
Contributions to open-source ML projects