Sensor Fusion Intern

The Zoox Sensor Fusion Detection team is developing the next-generation Perception model to achieve the following goals:

1. Unify the existing PixelSpace Range View representation with the VoxelSpace Voxel representation into one architecture

2. Produce more outputs: upgrade the model architecture to predict more outputs, including 3D object detection (3D bounding box with velocity), 3D panoptic segmentation (3D contour), occlusion, occupancy, scene flow and object attributes

3. Consume multi-frame temporal information: upgrade the model architecture to consume multi-frame sensor data (multi-view images, and multi-frame Lidar and Radar point cloud)

4. Add language and audio as additional modalities: upgrade the model architecture to take language and audio as input in addition to Vision, Lidar and Radar inputs

5. Utilize sensor data sparsity to reduce training and inference latency in order to consume higher resolution images, increase detection range, and deploy the model to more camera views

Technical Qualifications & Language Requirements

• Experience with applying Transformer to solve Perception problems in Autonomous Driving, or solve CV/ML problems
• Experience with the design, implementation, training and evaluation of Large Multimodal Model (LMM), or Large Vision-Language Model (LVLM), or Large Language Model (LLM)
• Proficient in PyTorch model design, implementation, training and evaluation
• Proficient in Python programming
• Computer Science or Electrical Engineering background with PhD degree

Bonus Qualifications

• Experience writing C++ software
• GPU/CUDA programming experience
• Experience with model deployment with TensorRT
• Experience working with LiDAR, Camera and Radar data
• Experience in algorithm development for Autonomous Driving software

Compensation

The monthly salary range for this position is $6,500 to $9,500. Compensation will vary based on role, degree level and type, and benefits will be offered based on eligibility. Additional benefits may include medical insurance, 401k, and a housing stipend.

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Follow us on LinkedIn

Accommodations

If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.

A Final Note:

You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.