Senior Software Engineer, ML Data Services

Summary

Join our ML Data Services team as a Senior Engineer to build and improve data infrastructure for Autonomy ML teams, designing scalable microservices, APIs, and tooling, and architecting pipelines to process terabytes of data.

Requirements

• 5+ years of software development experience with Python or Java
• 5+ years of web backend development experience with REST APIs and microservices
• 3+ years of AWS cloud experience (e.g., DynamoDB, API Gateway, EKS, Lambda, OpenSearch, Redshift, S3)
• 3+ years of data engineering experience with Airflow or AWS Step Functions
• Strong written and oral communication skills
• Experience working in cross-functional development teams
• Ability to mentor junior engineers
• BS or MS in Computer Science or related field

Responsibilities

• Design and implement Restful APIs and microservices for data labeling and annotations
• Architect, build and maintain scalable data processing pipelines with cloud ETL technology to deliver datasets for Autonomy teams
• Design and implement a data linter framework to monitor and improve data quality
• Work closely with leadership and stakeholders to define objectives, align timelines, agree on key deliverables, and build the execution plan

Preferred Qualifications

• Hands-on experience with using Ray or Spark in a large-scale environment
• Web backend development experience with .NET and C#
• Autonomous driving industry experience