Remote Data Engineer

Summary

Join Lyft's early-stage team as a Data Engineer to build a scalable data platform and contribute to the company's mission of improving people's lives with the world's best transportation.

Requirements

• 4+ years of relevant professional experience
• Strong experience with Spark and SQL
• Strong skills in a scripting language (Python, Bash, etc)
• Experience with some of the following: Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
• Experience of driving building complex data models and pipelines
• 2+ years of experience with workflow management tools (Airflow or similar)

Responsibilities

• Own the core company data pipeline, be responsible for scaling up data processing flow to meet the rapid data growth at Lyft
• Evolve data model and data schema based on business and engineering needs
• Implement and adopt systems tracking data quality and consistency
• Propose and develop tools supporting self-service data pipeline management (ETL)
• SQL and MapReduce job tuning to improve data processing performance
• Drive the DE team tech roadmap and align it to the team and stakeholders
• Build well-crafted, well-tested, readable, maintainable code with data infrastructure cost and scalability in mind
• Participate in code reviews to ensure code quality and distribute knowledge
• Participate in on-call rotations to ensure high availability and reliability of workflows and data
• Unblock, support and communicate with internal & external partners to achieve results

Benefits

• Professional and stable working environment
• 28 calendar days for vacation and up to 5 paid days off
• 18 weeks of paid parental leave. Biological, adoptive and foster parents are all eligible
• Mental health benefits
• Family building benefits