Remote AI Runtime and Performance Manager

Summary

Join Modular as a Manager of Runtime and Performance Team to lead a team of engineers in analyzing performance characteristics of AI models on CPUs, GPUs, and other accelerators, and implement runtime optimization to improve device and memory utilization and efficiency. As a manager at Modular, you are expected to be deeply involved in the technical details, design, goal setting, and execution to satisfy Modular product and customers requirements.

Requirements

• 5+ years of experience in people management
• 10+ years of experience in the field of high performance computing
• Proven experience in developing a production quality high performance software for CPUs, GPUs or other devices
• Proven experience in system level performance analysis and runtime performance optimizations
• A robust understanding of the principles of hardware architectures such as CPUs, GPUs or other accelerators

Responsibilities

• As a manager at Modular you are expected to be deeply involved in the technical details, design, goal setting, and execution to satisfy Modular product and customers requirements
• You will nurture collaboration with the compiler, kernels, framework, serving and product teams to achieve state of the art performance
• Additionally, you will lead and collaborate across the company to understand customer model performance requirements, help customers to reach the performance goals and make design and architecture changes to help scale the product to multiple customers and HW vendors
• As a leader at Modular you will be involved in making architecture decisions, mentoring and growing your team and others in the company, establishing a strong expertise in your team and developing yourself and your team to be on the cutting edge of technology

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Very generous WFH setup stipends
• Flexible paid time off