Head of Cloud Inference

Summary

Join Modular, a company revolutionizing AI infrastructure, as the Head of Cloud Inference. Lead and scale a team building next-generation cluster-level AI inference solutions. Drive product strategy and design for an enterprise-grade cloud inference platform, collaborating with customers and internal teams. Develop and mentor a high-performing engineering team. Ensure reliable, effortless deployment of customer GenAI models. This role requires extensive experience in cloud infrastructure, AI/ML, and people management. The position offers competitive compensation, including stock options, and world-class benefits.

Requirements

• 7+ years of experience in people management
• 10+ years of experience in the field of cloud infrastructure
• Proven experience in developing production-quality high-performance software
• Proven experience in AI/ML infrastructure, model serving, or related field
• Proven experience in managing large teams and managing of managers
• A robust understanding of the principles cloud infrastructure and running large scale systems

Responsibilities

• Lead and scale the cloud inference organization to build next-generation cluster-level AI inference solutions
• Drive product strategy and design decisions for enterprise-grade cloud inference serving platform, work closely with customers to ensure their success while advancing Modular platform as the best platform for AI inference in production
• Coach, mentor, and develop a high-performance engineering team while fostering cross-functional collaboration with product and customer support teams
• Navigate fast-paced environment with changing priorities while establishing technical expertise and cutting-edge technology adoption
• Collaborate with engineering leaders to deliver integrated AI inference deployment solutions for enterprise customers

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off