Software Engineer, Vision Language Models

Summary

Join Motional's Data Mining team and spearhead new mining strategies and workflows to improve the performance of ML products for autonomous driving. You will develop core data products using multi-modal foundation models, contribute to large-scale mining workflows that identify rare objects and model errors, and conduct statistical analysis of model performance. This role requires a strong publication record in top-tier conferences, fluency in Python, experience with deep learning frameworks, and solid software engineering principles. Motional offers a competitive salary and benefits package, including medical, dental, vision, 401k, and more. The team is focused on improving the safety and reliability of autonomous vehicles and is committed to creating a diverse and inclusive work environment. Motional is a leader in the autonomous driving industry, with a proven track record of innovation and a commitment to scaling its technology for commercialization.

Requirements

• MS/PhD in computer science, similar discipline or equivalent experience
• Strong publication record in top-tier conferences (e.g., ICCV, CVPR, ECCV)
• Fluency in Python
• Experience with PyTorch or other deep learning frameworks (Jax, Tensorflow etc.)
• Solid software engineering principles – such as software design patterns, source control, code reviews, testing methodologies, etc

Responsibilities

• Develop core data products leveraging and adapting multi-modal foundation models via fine-tuning, retrieval-augmented generation, in-context learning, continual pre-training, and knowledge distillation
• Contribute to large-scale mining workflows that surface rare objects, model errors & long-tail events
• Conduct statistical analysis of model performance and generalization in complex and diverse driving scenarios

Preferred Qualifications

• Experience in one or more of the machine learning paradigms: Representation Learning (Contrastive Learning, Metric Learning), Sequence Modeling (LSTM, Transformers), Few-shot Learning (Transfer Learning), and Generative Modeling (VAEs, Diffusion Models)
• Experience in utilizing data from camera, lidar, and radar
• Experience in applied machine learning for autonomous driving

Benefits

Medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance