Data Engineer II

Summary

Join OfferUp as a Data Engineer to build, operate, and scale data processing platforms. You will design and develop applications for processing large amounts of critical information, monitor and resolve data pipeline issues, collaborate with multiple teams to understand their data needs, and maintain and expand the data infrastructure. This role requires 3+ years of professional software development experience, strong distributed systems skills, excellent communication abilities, proficiency in SQL and Python, and experience with open-source data infrastructure projects. The position is only available outside the US. Building the largest and most responsive mobile marketplace presents unique data challenges, requiring leveraging the latest developments in data infrastructure. Come help us do that!

Requirements

• 3+ years of professional software development experience
• Strong ability in distributed systems for processing large scale data processing
• Ability to communicate technical information effectively to technical and non-technical audiences
• Proficiency in SQL and Python
• Experience leveraging open source data infrastructure projects, such as Airflow, Kafka, Avro, Parquet, Hadoop, Hive, HBase, Presto or Druid
• Experience building scalable data pipelines and real-time data streams
• Experience building software in AWS or a similar cloud environment
• Computer Science or Engineering degree required, Masters degree preferred
• Excellent communication skills, both written and spoken (fluency in English required)

Responsibilities

• Design and develop applications to process large amounts of critical information to power analytics and user-facing features
• Monitor and resolve data pipeline or data integrity issues
• Work across multiple teams to understand their data needs
• Maintain and expand our data infrastructure

Preferred Qualifications

• Experience with AWS services like Kinesis, Firehose, Lambda, Sagemaker
• Experience with GCP services like BigQuery, Cloud Functions
• Experience with operational tools like Terraform, Datadog and Pagerduty