Remote Senior Data Engineer

Summary

Join our Data Engineering team to tackle HomeLight's diverse data challenges and own the development, optimization, and operation of our data pipeline.

Requirements

• 5+ years of Python and ETL experience, preferably Airflow
• Experience writing and executing complex SQL queries
• Experience building data pipelines and ETL design (implementation and maintenance)
• Scrum/Agile software development process

Responsibilities

• Optimize and execute on requests to pull, analyze, interpret and visualize data
• Partner with team leaders across the organization to build out and iterate on team, and individual performance metrics
• Optimize our data release processes, and partner with team leads to iterate on and improve existing data pipelines
• Design and develop systems that ingest and transform our data streams using the latest tools
• Design, build, and integrate new cutting-edge databases and data warehouses, develop new data schemas and figure out new innovative ways of storing and representing our data
• Research, architect, build, and test robust, highly available and massively scalable systems, software, and services

Preferred Qualifications

• Familiarity with chatgpt, transcription analysis
• Familiarity with AWS, Elasticsearch, Django
• Experience setting up and managing internal API services
• Experience working on a small team, ideally at a startup
• Familiarity with the Amazon AWS ecosystem