Director of AI Compute Services

Summary

Join CoreWeave, a leading AI hyperscaler, as the Director of AI Compute Services. In this role, you will architect CoreWeave's compute services, build and lead a high-performing team, and ensure the highest levels of service quality, scalability, and performance. You will collaborate with engineering, product, and sales teams to shape the compute infrastructure roadmap and drive innovation. This leadership position demands strong technical expertise, strategic vision, and business acumen. You will focus on achieving optimal performance and cost-efficiency across GPU-based compute resources while supporting strategic client engagements. CoreWeave offers competitive compensation, equity, and benefits in a high-growth environment.

Requirements

• 10+ years of experience in infrastructure, high-performance compute, or cloud systems
• 5+ years of experience in engineering leadership roles
• Proven track record of building and scaling high-performing engineering teams and fostering a positive and productive team culture
• Experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture
• Good understanding of AI/ML model training, inference workflows, and performance tuning
• Bachelor’s or Master's degree in Computer Science or Compute Architecture, or equivalent practical experience

Responsibilities

• Define and execute CoreWeave’s AI compute roadmap in alignment with our growth trajectory and customer needs
• Collaborate with product, infrastructure, sales, and engineering teams to support GPU-intensive workloads and strategic client deployments
• Grow and lead a high-performance team of infrastructure, systems, and AI platform engineers
• Design and manage large-scale GPU cluster environments
• Help drive architecture decisions around high-throughput networking, low-latency storage, and resource scheduling for AI/ML workloads
• Ensure optimal performance and utilization across massive-scale GPU deployments
• Evaluate and integrate next-gen hardware and software technologies
• Develop scheduling, orchestration, and containerization strategies (e.g., Kubernetes, Slurm) tailored for deep learning workloads
• Provide internal and external clients with robust, secure, and performant AI environments
• Define customer-centric SLAs and Implement effective monitoring systems to ensure infrastructure uptime and efficiency
• Optimize for both performance and cost-efficiency across GPU-based compute resources
• Support strategic client engagements with technical solutions and infrastructure design
• Represent CoreWeave in partner/vendor relationships with hardware and software ecosystem players
• Act as a technical voice of the customer in shaping internal product and infrastructure roadmaps
• Collaborate effectively with open source communities

Preferred Qualifications

• Experience at a cloud provider or hyperscaler
• Familiarity with MLOps, workload telemetry, and multi-tenant compute environments
• Demonstrated success scaling infrastructure for LLMs or foundation models
• Strong business acumen in balancing cost, performance, and reliability at scale

Benefits

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company-paid Life Insurance
• Voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Mental Wellness Benefits through Spring Health
• Family-Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full-service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption