Skip to main content

Principal Software Engineer - AI Frameworks at Microsoft

Department: Software Engineering

Compensation · Listed in posting

$165,600 – $296,400/yr

Setup
Remote
Type
Full-time
Level
staff+
Posted

Description

Microsoft is hiring a Principal Software Engineer – AI Frameworks to lead technical direction and hands-on implementation for AI frameworks, model-serving systems, compilers, runtimes, observability, benchmarking, and hardware platforms including NVIDIA, AMD, and Microsoft silicon. The role owns architecture, roadmap, cross-team alignment, measurement, and production reliability while mentoring engineers and driving improvements in model onboarding, performance, and capacity efficiency. Candidates need a bachelor’s degree in computer science or a related field and at least 8 years of technical engineering experience coding in C++ or Python, with equivalent experience accepted; preferred qualifications include advanced experience with LLM inference frameworks, accelerator kernel optimizations, distributed systems, and technical leadership.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation