Senior Data Engineer

Summary

Join Perchwell, a rapidly growing real estate data and workflow platform company, as a Senior Data Engineer. You will play a key role in building and scaling our data infrastructure, including developing a data lake and warehouse solution. Collaborate with cross-functional teams to create robust data solutions and shape the data engineering team's culture. This role offers the flexibility of fully remote or hybrid work from our SoHo NYC office. We are seeking a candidate with extensive experience in data engineering, including ETL pipelines, data governance, and cloud technologies. The compensation package includes a competitive salary, equity, and benefits.

Requirements

• 4+ years experience in data engineering including experience with Python, SQL, or Kotlin
• Experience building scalable and fault tolerant data pipelines with data originating from 3rd party API’s for batch and real-time use cases
• Expertise with any of ETL schedulers such as Airflow (preferred), Dagster, Prefect or similar frameworks
• Experience with cloud architecture (preferably AWS) and technologies including S3, SQS, RDS, EMR, Glue, Athena, and Lambda
• Experience working with data warehouses: redshift, snowflake, ClickHouse or google bigquery
• Experience building CI/CD pipelines using GitLab, GitHub actions, Terraform, or Jenkins
• Familiarity with microservices architecture and cloud data lake implementations
• Excellent communication skills, both oral and written, with a demonstrated ability to effectively collaborate with cross-functional teams

Responsibilities

• Build out ETL tooling and data pipelines, consuming data into our system from 3rd party data sources and APIs
• Design and implement automated data governance measures to improve data quality and observability
• Build out team processes and culture around ownership and accountability
• Partner with Data Analyst team that will act as partner team to conduct analysis, dashboards, and quality assessments

Preferred Qualifications

• Certifications in AWS
• Springboot/Java experience

Benefits

• Equity
• Benefits
• Remote work, flexible hours