Summer Intern, Model Performance Optimization

Summary

Join us at Waymo for a fun and rewarding internship! As a software engineering intern, you will build infrastructures for custom kernels integrations for Transformer-based models, evaluate the quality and performance of different techniques of quantization and custom kernels, and stage the optimizations to many end-product models.

Requirements

• Progressing towards MS or PhD in Computer Science or related technical field
• Software development experience with Python
• Knowledge of Transformers basics and profiling Transformers
• Experience with profiling models / binaries

Responsibilities

• Build infrastructures for custom kernels integrations for Transformer-based models
• Evaluate the quality and performance of different techniques of quantization and custom kernels
• Stage the optimizations to many end-product models

Preferred Qualifications

• Experience with model quantizations
• Experience with large model inference / training
• Experience with Pytorch or Jax

Benefits

Generous benefits programs