Senior Data Engineer

Summary

Join Agility Robotics' cutting-edge team and build the data platform powering fleet-scale humanoid robotics. As a Senior Software Engineer, you will design, develop, and maintain the infrastructure for efficient data ingestion, processing, and analysis from our robots. Your work will directly impact robot performance and scaling our cloud-based systems. This role requires extensive experience in building and scaling cloud-based data platforms, big data frameworks, and distributed systems. Agility Robotics offers a comprehensive benefits package including competitive compensation, 401k matching, equity, comprehensive insurance, generous PTO, and various other perks.

Requirements

• 5+ years of strong experience in building and scaling cloud-based data platforms with familiarity in cloud providers like AWS, GCP or Azure
• Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
• Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf
• Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
• Proficiency in languages like Python, Java or Scala (any JVM) and a solid understanding of distributed systems and microservices architectures

Responsibilities

• Design and implement scalable data pipelines for ingesting and processing telemetry, logs and sensor data from our fleet of robots and associated cloud software
• Develop and maintain data ingestion agents running directly on robot software to ingest high volume data in low connectivity environments
• Maintain and develop data formats and protocols optimized for transmission, storage and query of data recordings, sensor data and telemetry
• Develop and maintain observability systems using tools like fluentbit, OpenTelemetry etc enabling real-time monitoring and analytics of fleet operations
• Implement solutions to prepare high volume, high velocity data for analysis using technologies such as Spark, Kafka or equivalent
• Build and optimize tools for internal stakeholders for business intelligence and long-horizon fleet analytics and forecasting using existing tools like AWS S3, Athena, Sagemaker etc
• Leverage IoT experience to improve data collection and processing pipelines from robot sensors and edge devices

Preferred Qualifications

• Experience with Robotics, Autonomous Vehicles, or other sensor heavy workloads
• Knowledge of IoT systems, edge computing or working with embedded devices
• Experience with Kubernetes
• Experience with Bazel/Blaze or other build systems
• Experience with C++, Rust, TypeScript
• Experience with robot data formats like mcap, ROS etc and data playback and visualization tooling like Foxglove etc

Benefits

• 401(k) Plan: Includes a 6% company match
• Equity: Company stock options
• Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees
• Benefit Start Date: Eligible for benefits on your first day of employment
• Well-Being Support: Employee Assistance Program (EAP)
• Time Off: Exempt Employees: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown
• Time Off: Non-Exempt Employees: 10 vacation days, paid sick leave, and 10 company holidays, including a winter shutdown, annually
• On-Site Perks: Catered lunches twice a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations
• Parental Leave: Generous paid parental leave programs
• Work Environment: A culture that supports flexible work arrangements
• Growth Opportunities: Professional development and tuition reimbursement programs
• Relocation Assistance: Provided for eligible roles