AI Compiler Engineer at Modular

We are building the next generation of AI infrastructure to help developers create faster, smarter, and more efficient machine learning systems. At Modular, our work centers on the core technologies that power modern AI, and we are looking for engineers who want to shape how these systems are built and optimized at scale.

About the Role

We are hiring a Senior AI Compiler Engineer to join us on a full-time basis. In this position, you will design and implement compiler infrastructure that supports multiple machine learning frameworks and hardware platforms, helping us deliver a flexible and high-performance product for developers worldwide.

Key Responsibilities

• Design and build an MLIR-based machine learning compiler with scalable infrastructure that supports a wide range of models and devices.
• Develop generic and extensible optimizations that improve performance for machine learning models across multiple frameworks and hardware targets.
• Collaborate with machine learning researchers and engineers to align compiler development with emerging trends and ensure the stack fully utilizes modern server and mobile systems.

Requirements

We are looking for candidates with at least eight years of compiler engineering experience and a strong foundation in core compiler algorithms and data structures. You should have hands-on experience building compilers for machine learning, such as XLA, Glow, TVM, nGraph, TensorRT, or IREE, along with proven work in machine learning graph optimizations. In-depth knowledge of C++ and familiarity with GitHub workflows like pull requests are essential. Strong communication skills and a collaborative approach to working across teams are also important. Experience with MLIR and LLVM, model quantization at eight bits or lower, or an advanced degree in computer science is helpful but not required.

Location

This role is fully remote, and we welcome applicants based anywhere in the United States or Canada.

Compensation and Benefits

The estimated base salary range for this role in the US is $234,000 to $319,000 USD, with equity forming a significant part of total compensation. In addition to competitive pay, we offer remote work flexibility, a 401k plan with up to 5% matching, stock options, premier insurance plans, generous work-from-home setup stipends, flexible paid time off, and regular team-building events and onsites.