Cloud Inference Tech Lead

Summary

Join Modular, a company revolutionizing AI infrastructure, as the Cloud Inference Tech Lead. You will play a key role in developing and implementing key features for Modular's next-generation platform, focusing on a GenAI cluster-level inference product. This leadership position requires mentoring others, setting the technical direction, and driving product strategy. You will collaborate with customers and engineers to ensure a seamless experience with Modular's large-scale AI cloud inference solutions. The role demands proven experience in cloud infrastructure, AI/ML infrastructure, and high-performance cloud solutions. Modular offers competitive compensation, including stock options, and world-class benefits such as premier insurance plans, 401k matching, and flexible paid time off.

Requirements

• 10+ years of experience in the field of cloud infrastructure
• Proven experience in developing production-quality high-performance cloud solutions
• Proven experience in AI/ML infrastructure, model serving, or related field
• Proven technical leadership and cross team collaboration
• Track record of customer excellence
• A robust understanding of the principles and execution of operating large scale systems on cloud infrastructure

Responsibilities

• Mentor others and help set the technical direction of the team and Modular at large in the domain of large scale GenAI inference
• Drive product strategy and design decisions for enterprise-grade cloud inference serving platform, work closely with customers to ensure their success while advancing Modular platform as the best platform for AI inference in production
• Drive, and support Modular fast-paced growth of supporting customers and enabling new use-cases, with changing priorities, while applying technical expertise and cutting-edge technology solutions
• Collaborate with product and other engineers and leaders to support the best customer experience of fully integrated, large scale Gen AI cloud inference deployment solutions

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off