Senior Data Engineer

Summary

Join Constructor's Data Lake Team as a Senior Data Engineer and contribute to the development and maintenance of their data platform. You will work on a team responsible for data platform support, pipeline framework development, data modeling, and data quality. The ideal candidate has at least 4 years of experience in big data engineering, web services, and cloud platforms (ideally AWS), with strong programming skills in Python. You will own and evolve the pipeline framework, shift workloads from batch to streaming, design and develop the data quality framework, and develop tooling for backfills. Constructor offers a fully remote work environment, unlimited vacation time, a work-from-home stipend, Apple laptops, a training and development budget, maternity/paternity leave, and regular team offsites.

Requirements

• At least 4 years of experience
• Strong programming skills (ideally in Python)
• Expertise in big data engineering, web services, and cloud platforms (ideally AWS)

Responsibilities

• Data platform support (PySpark, Databricks, EMR, Luigi, Airflow)
• Development, optimization and maintenance for data pipelines framework to run 10 000+ of pipelines on a daily basis
• Data modeling (bronze, silver, gold)
• Development and maintenance of a Data Quality framework built on top of DBT
• Development and maintenance of user facing service for the behavioral data ingestion (FastAPI, Docker, AWS ECS)
• Own and evolve our pipeline framework that orchestrates 10 000+ jobs daily
• Shift workloads from batch to streaming, shrinking model-to-production latency from days to hours
• Design and develop the Data Quality framework and wire it into every Constructor core service
• Enable Spark on Kubernetes, giving teams elastic, cost-efficient compute
• Develop tooling for delivering backfills throughout the data platform

Benefits

• Unlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year
• Fully remote team - choose where you live
• Work from home stipend! We want you to have the resources you need to set up your home office
• Apple laptops provided for new employees
• Training and development budget for every employee, refreshed each year
• Maternity & Paternity leave for qualified employees
• Regular team offsites to connect and collaborate