Remote Data Engineer, Global Market

Summary

Join the Global Markets engineering team at Airbnb as a Data Engineer to evolve the guest and host experience for global markets through new product initiatives.

Requirements

• 3+ years of relevant industry experience
• Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
• Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
• Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
• Expert in at least one programming language for data analysis (e.g. Python, R)

Responsibilities

• Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources
• Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
• Ensure the quality, performance, and stability of data systems with thoughtful quality systems and monitoring
• Collaborate with cross-functional teams to define data requirements, and deliver data solutions
• Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues

Benefits

China - Remote Eligible