Lead AI Graph Compiler Engineer

Modular
Summary
Join Modular, a company revolutionizing AI infrastructure, as a Lead AI Graph Compiler Engineer. You will build and enhance a machine learning compiler, focusing on scalability and high-quality infrastructure. Responsibilities include writing extensible optimizations, analyzing and improving performance across various model architectures, and collaborating with other teams for hardware utilization. This role requires 5+ years of compiler engineering experience, expertise in MLIR and LLVM, and proficiency in C++. The ideal candidate will possess knowledge of core compiler algorithms and experience with machine learning frameworks like PyTorch. Modular offers competitive compensation, including stock options, and world-class benefits such as premier insurance plans, 401k matching, and flexible paid time off. The position is open to US and Canada-based candidates with remote work options.
Requirements
- 5+ years of compiler engineering experience
- Experience working with compilers for machine learning frameworks, such as PyTorch
- Knowledge of core compiler algorithms and data structures
- Knowledge of and experience working with MLIR and LLVM
- Knowledge of C++, as well as, knowledge of basic GitHub workflows like pull requests
- Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture
Responsibilities
- Build an MLIR and LLVM-based machine learning compiler with scalable and high quality infrastructure
- Write generic and extensible optimizations, such as constant folding, operation fusion, model parallelization, and quantization
- Analyze and improve performance across multiple different model architectures
- Work with other teams to provide a balanced stack that fully utilizes todayβs complex hardware
Preferred Qualifications
- Experience with ML graph optimizations, parallel / distributed programming, heterogeneous ML computation, and/or code generation
- Advanced degree in Computer Science or a related area is a plus
Benefits
- Premier insurance plans
- Up to 5% 401k matching
- Flexible paid time off