Lead AI Graph Compiler Engineer

Summary

Join Modular, a company revolutionizing AI infrastructure, as a Lead AI Graph Compiler Engineer. You will build and enhance a machine learning compiler, focusing on scalability and high-quality infrastructure. Responsibilities include writing extensible optimizations, analyzing and improving performance across various model architectures, and collaborating with other teams for hardware utilization. This role requires 5+ years of compiler engineering experience, expertise in MLIR and LLVM, and proficiency in C++. The ideal candidate will possess knowledge of core compiler algorithms and experience with machine learning frameworks like PyTorch. Modular offers competitive compensation, including stock options, and world-class benefits such as premier insurance plans, 401k matching, and flexible paid time off. The position is open to US and Canada-based candidates with remote work options.

Requirements

• 5+ years of compiler engineering experience
• Experience working with compilers for machine learning frameworks, such as PyTorch
• Knowledge of core compiler algorithms and data structures
• Knowledge of and experience working with MLIR and LLVM
• Knowledge of C++, as well as, knowledge of basic GitHub workflows like pull requests
• Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture

Responsibilities

• Build an MLIR and LLVM-based machine learning compiler with scalable and high quality infrastructure
• Write generic and extensible optimizations, such as constant folding, operation fusion, model parallelization, and quantization
• Analyze and improve performance across multiple different model architectures
• Work with other teams to provide a balanced stack that fully utilizes today’s complex hardware

Preferred Qualifications

• Experience with ML graph optimizations, parallel / distributed programming, heterogeneous ML computation, and/or code generation
• Advanced degree in Computer Science or a related area is a plus

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off