Remote Senior Staff Software Engineer

Summary

The job is for an experienced Technical Lead in ML Acceleration team at Stack AV, responsible for designing architecture and leading a team to automate optimization and deployment of complex ML models for autonomous vehicles. The role requires deep understanding of GPUs and optimization, excellent leadership skills, and staying updated with the latest technologies in ML inference and ML accelerators.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
• 5+ years of experience in GPU programming and optimization

Responsibilities

• Analyze and profile ML models to identify performance bottlenecks
• Use OSS tooling to enhance the platform for enabling ML engineers to profile models and optimize them
• Automate the process of exporting the model to an optimized format (e.g., TensorRT) and deploying them
• Implement optimizations using CUDA, Triton, and custom kernels
• Collaborate with ML researchers to balance model accuracy and speed
• Lead efforts within the team as well as cross-team projects related to model optimization and deployment
• Collaborate with cross-functional teams to understand data requirements and design appropriate solutions
• Stay updated with the latest technologies and trends in ML inference and ML accelerators
• Identify and resolve performance bottlenecks in models
• Set a culture of engineering excellence within the team and work closely with the management and customer teams to balance between speed of delivery and quality of engineering artifacts