Senior Software Engineer at CommonAI

Setup: Hybrid
Location: Cambridge, England
Type: Full-time
Level: not_specified
Posted: Jun 26, 2026

Description

CommonAI CIC is looking for a Senior Software Engineer passionate about open-source AI infrastructure. The role involves deploying, extending, and optimizing vLLM for various programs like the Scaling Inference Lab and High Assurance program. Key tasks include implementing new features, collaborating with the open-source community, troubleshooting performance issues, and leveraging LLMs and AI coding assistants.

Required Skills

Python
Low-level programming
C/C++
Rust
Assembly
CUDA
LLMs
Coding Assistants
Autonomous Agents
vLLM
PyTorch
Hugging Face TGI
TensorRT-LLM
Ray
LLM inference mechanics
KV caching
Continuous Batching
Memory Management
Model Quantization
Performance Optimisation
Hardware Accelerators
GPUs
TPUs
CPU Vector Units
Modern MLOps Practices
CI/CD
Large-Scale Deployments

Additional Information

Required Previous Experiences: Deep expertise in both Python and low-level programming (e.g. C/C++, Rust, assembly or CUDA)
Direct contributions to vLLM or similar high-performance open-source ML/AI projects (e.g. PyTorch, Hugging Face TGI, TensorRT-LLM, Ray)
Strong understanding of LLM inference mechanics (e.g. KV caching, continuous batching, memory management, model quantisation)
Experience interacting with, and upstreaming code to, active open-source communities.
Hands-on experience working on performance optimisation for hardware accelerators (GPUs, TPUs, CPU vector units or other accelerators)
Strong enthusiasm for using LLMs, coding assistants, and agents as core tools in your own software development process.
Preferred Qualifications: Experience working on software systems that operate in highly regulated or high-assurance environments (e.g. financial services).
Understanding of the latest AI safety research and active involvement in that community.
Deep knowledge of modern MLOps practices, CI/CD, and large-scale deployments.