Summary
Join Airbnb's Data Engineering team and build robust data pipelines, ensuring data quality and consistency for critical business decisions. Collaborate with cross-functional teams to define data requirements and deliver data solutions that drive merchandising and sales improvements. Contribute to the broader Data Engineering community, influencing tooling and standards. Leverage and contribute to internal tools to improve code and data quality. This role is US-Remote Eligible, with occasional office work or offsites as agreed upon with your manager. The position requires 5-9+ years of relevant experience with a BS/Masters, or 2+ years with a PhD.
Requirements
- 5-9+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD
- Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
- Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
- Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
- Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
- Excellent written and verbal communication skills
Responsibilities
- Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds
- Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy
- Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
- Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements
- Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity
- Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues
Benefits
- This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits
- $191,000 β $223,000 USD
Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.