Principal Software Engineer, Kernels at d-Matrix

Department: Software Engineering

Compensation

$195,000 – $285,000/yr

Setup: Hybrid
Location: California
Type: Full-time
Level: staff+
Posted: Jul 15, 2026

Description

d-Matrix is hiring a Principal Software Engineer, Kernels to help productize the software stack for its AI compute engine. The role focuses on developing, enhancing, and maintaining software kernels for next-generation AI hardware, mapping computational graphs to hardware architectures, optimizing hardware-software co-design, and building compiler infrastructure with compiler, ML, systems, and hardware experts. The position is hybrid, requiring onsite work at the Santa Clara, California headquarters for at least three days per week.

Required Skills

Software kernels
Computer architecture
C/C++
Python
CUDA
MLIR
LLVM
TVM

Additional Information

Minimum Education: Master of Science in computer engineering, mathematics, physics, or a related field, or a PhD in a related field.
Required Previous Experiences: 10+ years of industry experience for the MS degree path.
5+ years of industry experience for the PhD degree path.
Experience implementing algorithms in C/C++ and Python.
Experience implementing algorithms for FPGAs, DSPs, GPUs, and AI accelerators using CUDA or similar libraries.
Experience implementing GEMM, convolution, BLAS, and SIMD operators for machine learning workloads.
Experience developing for embedded SIMD vector processors such as Tensilica.
Preferred Qualifications: Prior startup, small-team, or incubation experience.
Experience with TensorFlow or PyTorch.
Experience with ML compilers and algorithms such as MLIR, LLVM, TVM, or Glow.
Experience with deep learning frameworks and machine learning models for computer vision, natural language processing, or recommendation systems.
Work experience at a cloud provider or AI compute or subsystem company.