Senior AI Modeling Engineer

Summary

Join Modular's GenAI Modeling team and implement cutting-edge models on our next-generation AI platform. As a senior modeling engineer, you will leverage your deep learning expertise to implement, test, and validate models, mentoring junior engineers. Your work will enrich Modular's model library, serve as example code for the MAX developer ecosystem, and directly influence platform development. You will develop high-level ML code using Python APIs and basic kernels using the Mojo programming language. This role offers the opportunity to work remotely or in our Los Altos, CA office and contribute to a team revolutionizing AI infrastructure. Competitive compensation, including stock options, and world-class benefits are offered.

Requirements

• Solid understanding of deep learning architectures and concepts such as transformers, diffusion models, attention, KV cache, and more
• Strong experience with Python, core numerical libraries (like NumPy) and deep learning frameworks (e.g., Pytorch, JAX, Tensorflow)
• Solid Python coding skills
• Good grasp of related mathematical concepts, especially linear algebra

Responsibilities

• Develop AI models, with a focus on GenAI and LLMs, using the MAX platform's Python APIs
• Research and stay up-to-date on the latest model architectures, such as Llama and DeepSeek
• Implement novel models and architectures based on research papers
• Test and evaluate the inference accuracy of models
• Mentor less experienced engineers on model architectures, implementation details, and effective use of modern APIs like PyTorch
• Collaborate with the MAX Platform team by providing feedback on API design and developer experience
• Work with leads and product managers to estimate and plan the development of new models

Preferred Qualifications

• Kernel development experience (CUDA, TritonLang, etc.)
• Deep learning research experience
• ML API development experience
• Experience training or deploying deep learning models
• Understanding of performance tradeoffs in modern accelerators

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off
• Competitive Compensation
• Stock options