Principal Software Engineer - Compute Graph Compiler

Overview

The Compute Graph Compiler (CGC) team within DirectX is building core compiler and execution technologies that power the Windows Machine Learning Platform. Our mission is to make Windows the best platform for AI development and deployment, enabling efficient execution of machine learning workloads across CPUs, GPUs, and NPUs from a broad ecosystem of silicon partners. CGC sits at the heart of the Windows ML ecosystem, powering experiences used by millions of developers and customers worldwide. Our technologies enable computer vision, audio, video, gaming, and generative AI workloads across the Windows platform, including emerging AI-first experiences and next-generation Copilot+ PC capabilities. As AI becomes a fundamental platform shift, CGC is responsible for the compiler infrastructure, optimization frameworks, execution engines, and hardware abstractions that unlock the performance and efficiency of modern AI accelerators. We work closely with Microsoft AI platform teams, hardware partners, and operating system components to define the future of AI execution on Windows.

We are looking for a Principal Software Engineer to help define and drive the next generation of AI compute infrastructure for Windows. In this role, you will lead architecture and technical strategy across compiler technologies, execution runtimes, and hardware acceleration platforms spanning CPUs, GPUs, and NPUs. You will influence the direction of Microsoft's AI platform, collaborate with industry-leading silicon partners, and drive innovations that enable efficient execution of increasingly complex AI workloads. This role is ideal for engineers who are energized by large-scale platform engineering, deep systems work, and the opportunity to shape technology that impacts millions of users and developers.

Responsibilities

• Define and drive the technical vision, architecture, and roadmap for key components of the Windows ML compiler stack.
• Lead cross-team initiatives that improve AI workload performance, scalability, and efficiency across CPU, GPU, and NPU hardware.
• Drive NPU enablement strategy and advanced optimization techniques for next-generation AI processors.
• Partner with hardware vendors and internal platform teams to influence future AI hardware and software capabilities.
• Design and develop high-performance compiler infrastructure, execution engines, and developer tooling.
• Identify and solve complex systems challenges involving scheduling, memory management, code generation, graph optimization, and hardware abstraction.
• Mentor engineers and provide technical leadership across multiple projects and organizations.
• Help shape Microsoft's long-term strategy for on-device AI and generative AI execution on Windows.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with production-quality systems software, AI/ML platforms, or related technologies
• OR equivalent experience

Preferred Qualifications:

• Demonstrated experience designing and delivering production-quality systems software, AI/ML platforms or related technologies.
• Committed hands-on experience with ML compilers, runtimes, frameworks, tools and platform technologies.
• In-depth operating system development experience, including user-mode and/or kernel-mode driver development.
• Experience designing ML accelerator or hardware microarchitecture for real-world products, and connecting that hardware with compilers, runtimes, drivers and frameworks.
• Knowledge of computer architecture, heterogeneous computing, memory systems, parallel processing and hardware/software co-design.
• Proven experience optimizing ML workloads across the full software and hardware stack, including GPU optimization.
• A track record of technical leadership: defining architecture and driving complex AI/ML research and development across hardware and software teams. This includes taking AI platforms or accelerators from early design and prototypes through to production.

#W+DJOBS

Software Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.