Data Engineer

Summary

Join Snowplow's AI team and contribute to the development of Snowplow Signals, a new solution for real-time, AI-powered customer experiences. You will build and maintain production SQL data models using dbt, focusing on scalability and performance. Responsibilities include building and optimizing real-time and batch data pipelines, supporting customer-facing teams, and actively participating in decision-making. This role requires expertise in SQL, DBT, batch and streaming data processing, feature engineering, and Python. Experience with cloud technologies and data warehousing is essential. The ideal candidate is a proactive learner, a clear communicator, and comfortable working autonomously within a remote team.

Requirements

• SQL and DBT are your thing . You master SQL, including manipulation of large data sets, performance tuning, etc
• You're adept with both batch and streaming data processing . You have experience building streaming pipelines using tools like Benthos , enabling real-time data ingestion, transformation, and delivery across various systems
• You understand feature engineering and management. You're familiar with tools like Feast for defining, materializing, and serving features in both real-time and batch contexts
• You have extensive experience using Python which is used for auto generating data models
• You are not new to engineering . You use CI/CD, and Git source control as part of your daily job. You have experience with testing frameworks
• You are a proactive learner . Eager to expand on your software engineering knowledge and adapt to new technologies essential for automating models and advancing our engineering practices
• You’re familiar with cloud technologies . You have experience working with data in a cloud data warehouse (Redshift, Snowflake, Databricks, or BigQuery)
• Experience with a modern data modeling technology (DBT)

Responsibilities

• Developing and maintaining a suite of production SQL data models used by our customer base and the community. Primarily focusing on dbt for packaging and execution
• Building out our offering around data modeling. You won’t just work on the data models themselves - you’ll work closely with Product and the wider Engineering team to shape the way we collect data via our trackers to build better data models, and drive what data model tooling we provide as part of our commercial offering as well
• Building and optimizing real-time and batch data pipelines that power personalization, recommendation engines, and predictive models — from streaming ingestion and transformation using Benthos , to materializing features for agentic use cases and customer-facing AI systems
• Supporting our prospect/customer facing teams by showcasing the possibilities with Snowplow data, such as powering personalisation and recommendation systems, or developing advanced models (marketing attribution, lifetime value, etc.)
• Being an active part in decision making on what we build to help our customers get more value out of Snowplow, and how we deliver it. You’ll bring a different perspective and we’ll want your input!
• Responsible for developing and productizing data models , focusing on scalability, performance and maintainability, and developing in-depth understanding of cloud data warehouses and common web and mobile analytics use cases

Preferred Qualifications

• You document and communicate clearly . Some experience with technical content writing would be a plus
• You are excited to work autonomously . You are able to drive technical initiatives from discovery until to the delivery phase
• You know we can’t do everything today. You’ll be pragmatic and balance our speed of delivery with our commitment to providing a reliable and trusted service to customers
• You want to join a remote team that depends on expert collaborators to work effectively. You’ll be a great communicator and enjoy working closely with the team