Senior Data Engineer

Summary

Join OfferUp as a Data Engineer to build, operate, and scale data processing platforms. You will be a technical lead, mentoring engineers and driving best practices. This role involves designing and developing applications for large-scale data processing, influencing technical direction, and contributing to a growing team. The position requires 5+ years of software development experience, expertise in distributed systems, and proficiency in SQL and Python. This role is only available outside the US.

Requirements

• 5+ years of professional software development experience
• Strong ability in distributed systems for processing large scale data processing
• Ability to communicate technical information effectively to technical and non-technical audiences
• Proficiency in SQL and Python
• Experience leveraging open source data infrastructure projects, such as Apache Spark, Airflow, Kafka, Flink, Samza, Avro, Parquet, Hadoop, Hive, HBase, Phoenix, Presto or Druid
• Experience building scalable data pipelines and real-time data streams
• Experience building software in AWS or a similar cloud environment
• Computer Science or Engineering degree required
• Excellent communication skills, both written and spoken (fluency in English required)

Responsibilities

• Be the technical lead on the team, owning the architecture of the data solutions, and the data platform
• Lead the team by example, mentor other engineers and help them with their growth
• Drive engineering best practices, set standards and propose larger projects which may require cross-team collaboration
• Design and develop applications to process large amounts of critical information in batch and near real-time to power user-facing features
• Influence technical direction for the company, leveraging your prior experiences and helping evaluate emerging technologies and approaches
• Help bring engineering maturity to a growing team that is at the center of a lot of critical initiatives for the company

Preferred Qualifications

• Experience with AWS services like Kinesis, Firehose, Lambda, Sagemaker
• Experience with GCP services like BigQuery, Cloud Functions
• Masters degree