Data Engineer

Summary

Join Roadie, a UPS company and a leading logistics management platform, as a Data Engineer. You will be a key member of our growing Data Engineering team, focusing on building, maintaining, and scaling data pipelines and CI/CD processes to support our streaming architecture. Collaborate with business and product owners to create valuable data for reporting and analytics, and contribute to the long-term strategy of our Data Platform architecture. This role requires extensive experience in data infrastructure, ETL/ELT processes, and working with various data technologies. You will be responsible for building efficient data pipelines, partnering with stakeholders, delivering data capabilities, and providing production support. Roadie offers a competitive compensation package and numerous benefits, including comprehensive health insurance, 401k matching, tuition assistance, flexible work schedule with unlimited PTO, and more.

Requirements

• 4+ years of experience building data infrastructure and platforms using streaming frameworks such as Kafka/Kinesis/Flink/Spark Structured Streaming, etc
• 3+ years of experience using CI/CD tools to build and deploy projects
• 3+ years of experience working with DevOps tools such as Docker, Kubernetes, AKS, Helm, Terraform, etc to own end-to-end deployment of Data Engineering projects
• 3+ years of experience with one or more language/framework such as Python/Scala/Spark/PySpark/Java/Hadoop
• 4+ years of experience with scaling production systems, ideally in a start-up environment
• 5+ years of experience working with data systems, data warehouse solutions, and ETL/ELT
• 3+ years of experience developing and optimizing dbt models, implementing best practices, and ensuring data quality through testing and documentation. Proficient in version control (Git) and integrating dbt with modern data warehouses (e.g., Snowflake, BigQuery, Redshift, PostgreSQL)
• 3+ years of experience working with workflow management tools such as Airflow/Luigi/Dagster
• 3+ years of experience with PostgreSQL, as well as MPP databases such as Redshift
• Bachelor's degree in Computer Science or related technical field or equivalent practical experience

Responsibilities

• Build efficient, high quality, integrated and increasingly real-time ETL/ELT pipelines to organize, collect, standardize and integrate data that facilitate more complete, accurate and consistent data for insights and reporting
• Partner with engineering, data science, and business stakeholders to build data insights and help them to achieve their business goals
• Deliver data capabilities and new data products to accelerate investments in data and democratize data across the enterprise
• Provide production support for data tools and data needs across the business
• Research and implement cutting edge solutions to solve challenges related to ETL/ELT, data processing, and analytics

Preferred Qualifications

• Experience working with Databricks/Qubole/Snowflake or similar platforms using Spark/PySpark/Scala
• Application and front end development experience
• Experience with AWS Zero-ETL
• Experience with OLAP datastores such as Clickhouse, Apache Pinot, Druid
• Experience with cloud-based architectures on AWS, GCE, or similar
• Experience with various data visualization tools such as Redash/Superset/Tableau/Lightdash/Power BI

Benefits

• Competitive compensation packages
• 100% covered health insurance premiums for yourself
• 401k with company match
• Tuition and student loan repayment assistance (that’s right - Roadie will contribute directly to your existing student loans!)
• Flexible work schedule with unlimited PTO
• Monthly 3-day weekends
• Monthly WFH stipend
• Paid sabbatical leave- tenured team members are given time to rest, relax, and explore
• The technology you need to get the job done