Skip to main content

Principal AI Software Engineer at Microsoft

Department: Software Engineering

Compensation

$142,800 – $274,800/yr

Setup
Hybrid
Location
Redmond, Washington · Mountain View, California · +1
Type
Full-time
Level
staff+
Posted

Description

Microsoft is hiring a Principal AI Software Engineer for its Compute System Architecture team within Azure Hardware Systems & Infrastructure. The role leads full-system software prototyping and proof-of-concept development for memory-tiering, pooling, overcommit, and other hardware/software co-design approaches aimed at reducing AI inference total cost of ownership. Responsibilities include workload characterization, LLM inference optimization, data-path analysis, performance modeling, and evaluation of CXL, GPU, storage, and networking subsystems. The position requires a bachelor's degree in computer science or a related technical field and at least six years of technical engineering experience with coding in languages such as C, C++, C#, Java, JavaScript, or Python; preferred qualifications include extensive systems software and hardware/software co-design experience. The typical U.S. base pay range is USD 142,800 to USD 274,800 per year, with higher ranges for the San Francisco Bay area and New York City metropolitan area.

For job seekers

Ready to find a role that actually fits?

Upload your résumé, start a Job Search Thread, and let Metaintro rank real openings against your experience — then guide you from search to offer.

Match

Compare live roles against your current evidence.

Position

Turn proof projects into role-specific applications.

Improve

Use market feedback to keep the skill plan current.

Return to navigation