Remote Data Engineer

Summary

The job involves ingesting all relevant data sources into a data lakehouse, building unified datasets to understand donors and fundraising interventions, reducing data quality incidents with automated data quality tests and monitoring, and making it easy to maintain the pipelines and tools. The role is a contractor position funded by a $100,000 grant for around one year.

Requirements

• Exceptional alignment with GiveDirectly Values
• Critical thinking and analytical approach necessary to develop technical solutions that scale and are resilient to changes over time
• Entrepreneurial mindset and stakeholder management skills required to identify, design, and execute technical solutions that solve important, ambiguous organizational problems
• Python, SQL, and spark expertise, along with core competencies required to ship high quality data pipelines and data tools fast
• Extensive experience with Databricks preferred; experience with Tableau is a plus

Responsibilities

• Ingest all relevant data sources into our data lakehouse (AWS, Databricks)
• Build new pipelines and jobs to ingest data from our website analytics platform and donor ticketing system
• Work with stakeholders to define metrics, facts, and dimensions necessary for new dashboards, analysis, ML models, and experimentation that will drive fundraising strategy
• Build pipelines to clean, transform, and combine data from all platforms into these actionable datasets
• Implement data quality tests and alerting for key donation, donor, and donor engagement variables
• Monitor job and pipeline performance
• Proactively identify and implement improvements to our existing pipelines
• Create comprehensive, easy to understand documentation to ensure effective knowledge transfer of your work

Benefits

• Compensation at a rate equivalent to $130,000 per year base salary in the United States
• Compensation at a rate equivalent to $74,000 per year base salary in Kenya
• Flexible work location