Kernel Engineering Manager

Summary

Join Modular, a company revolutionizing AI infrastructure, and lead the MAX Kernels team. This role involves overseeing engineers developing cutting-edge GPU kernels to accelerate Modular’s MAX platform, focusing on delivering state-of-the-art performance. You will drive kernel and algorithm development and optimization, collaborate with other teams on performance analysis, provide technical leadership, and mentor team members. The position requires significant experience in high-performance programming, GPU architecture, and people management. Modular offers competitive compensation, including stock options, and world-class benefits.

Requirements

• 7+ years of experience in people management
• 15+ years of experience in the field of high performance programming, performance analysis, and related areas
• Deep understanding of GPU computer architecture (memory hierarchies, tensor-cores, etc.) and their impact on algorithm design
• Self motivation with the ability to design, communicate and lead new projects
• Experience with GPU programming languages such as CUDA or OpenCL
• Familiarity with GPU assembly such as PTX and SASS
• Knowledge of SOTA frameworks such as CUTLASS, TRTLLM, Triton, etc
• Able to identify industry trends, analyze emerging technologies and disruptive paradigms
• Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture

Responsibilities

• Lead and scale the Kernel team responsible for developing cutting-edge AI algorithms and compute building blocks for the MAX platform across various GPU hardware
• Drive the development and optimization of kernels and algorithms to deliver top-tier performance and accuracy across the entire GenAI inference solution stack
• Collaborate with other teams to analyze and optimize AI performance on diverse GPU architectures throughout the stack
• Provide technical leadership by implementing new optimization approaches and staying current with the latest advancements in hardware and algorithms
• Make critical architectural decisions that impact the entire platform and guide the technical direction of the team
• Mentor team members and others within the company, fostering both personal and team development at the forefront of technology
• Establish and maintain deep technical expertise within the team while managing shifting priorities in a fast-paced environment
• Cultivate high-performing team culture and foster collaboration across the entire engineering organization

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off