Ai Performance Engineer

Summary

Join Modular, a company revolutionizing AI infrastructure, as an AI Performance Engineer. You will be part of a team optimizing the performance of Modular's MAX product. Responsibilities include measuring and analyzing performance, collaborating with other engineering teams, and building performance analysis tools. This role requires 5+ years of experience in performance analysis, expertise in performance measurement and modeling, extensive Python experience, and strong communication skills. Modular offers competitive compensation, including stock options, a strong benefits package (including premier insurance plans, 401k matching, and flexible paid time off), and opportunities for professional growth within a supportive team environment. The role can be performed remotely or in the Los Altos, CA office.

Requirements

• 5+ years of professional or postgraduate academic experience working on or researching performance analysis, tooling or benchmarking
• Expertise in performance measurement (i.e. benchmarking), modeling, and analysis on real-world workloads
• Extensive experience with Python
• Creativity and curiosity for solving complex problems
• Experience writing production-quality software
• Strong written and verbal communication skills

Responsibilities

• Measure, analyze, and identify opportunities to improve the performance of the MAX product under realistic and relevant usage patterns
• Partner with the product and customer teams to understand the performance of the MAX product in both standard and cutting edge AI applications and design benchmarks to reflect them
• Collaborate with the kernels and GenAI modeling team to bring up new model families
• Collaborate with the kernels and runtime team to bring up and optimize new GPUs and accelerators
• Collaborate with the cloud team to design and benchmark advanced serving features and new serving algorithms
• Build statistical models and tools to operate on benchmarking & telemetry data and help develop key insights for performance, cloud costs, etc

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off
• Competitive Compensation, including stock options
• Team Building Events