Senior Data Engineer

Summary

Join Thumbtack's Data Engineering team and help millions of people confidently care for their homes. Collaborate with engineers, analysts, data scientists, and machine learning engineers to design and curate data sets. Refine and evangelize a framework for integrating data-thinking into the software development lifecycle. Design, architect, and maintain core marketing datasets, data marts, and feature stores. Integrate with various teams to understand their data needs and design datasets. Drive data quality and best practices across different business areas. Help build the next generation data products based on real-time data products.

Requirements

• 4 or more years of experience designing and building data sets and warehouses
• Excellent ability to understand the needs of and collaborate with stakeholders in other functions, especially Analytics, and identify opportunities for process improvements across teams
• Expertise in SQL for analytics/reporting/business intelligence and also for building SQL- and Python-based transforms inside an ETL pipeline, or similar
• Experience designing, architecting, and maintaining a data warehouse and data marts that seamlessly stitches together data from production databases, clickstream data, and external APIs to serve multiple stakeholders
• Expertise building the above with a modern data stack based on a cloud-native data warehouse, in our case we use BigQuery, dbt, and Apache Airflow, but a similar stack is fine
• Strong sense of ownership and pride in your work, from ideation and requirements-gathering to project completion and maintenance

Responsibilities

• Collaboratively refine and evangelize a comprehensive framework for integrating data-thinking into the software development lifecycle for product teams
• Design, architect, and maintain core marketing datasets, data marts, and feature stores that support a blend of mature products and features with a rapidly evolving product line, in partnership with analytics, data science, and machine learning
• Integrate with teams consisting of product engineers, analysts, data scientists, machine learning engineers throughout Thumbtack to understand their data needs, and help design datasets with the same engineering rigor as any other software we design
• Drive data quality and best practices across different business areas
• Help build the next generation data products at Thumbtack, based on real-time data products on top of Apache Kafka