Data Engineer

Summary

Join Snowplow's AI team and contribute to the development of Snowplow Signals, a new solution for real-time, AI-powered customer experiences. You will build and maintain production SQL data models using dbt, expand the data modeling offering, and optimize real-time and batch data pipelines. This role involves collaborating with Product and Engineering teams to improve data collection and tooling. You will also support customer-facing teams by showcasing Snowplow's capabilities and actively participate in decision-making. The ideal candidate is proficient in SQL, DBT, and data processing, with experience in feature engineering and cloud technologies. This position requires strong communication and collaboration skills and the ability to work autonomously.

Requirements

• SQL and DBT are your thing. You master SQL, including manipulation of large data sets, performance tuning, etc
• You're adept with both batch and streaming data processing. You have experience building streaming pipelines using tools like Benthos, enabling real-time data ingestion, transformation, and delivery across various systems
• You understand feature engineering and management. You're familiar with tools like Feast for defining, materializing, and serving features in both real-time and batch contexts
• You have extensive experience using Python which is used for auto generating data models
• You are not new to engineering. You use CI/CD, and Git source control as part of your daily job. You have experience with testing frameworks
• You are a proactive learner. Eager to expand on your software engineering knowledge and adapt to new technologies essential for automating models and advancing our engineering practices
• You’re familiar with cloud technologies. You have experience working with data in a cloud data warehouse (Redshift, Snowflake, Databricks, or BigQuery)
• Experience with a modern data modeling technology (DBT)

Responsibilities

• Developing and maintaining a suite of production SQL data models used by our customer base and the community. Primarily focusing on dbt for packaging and execution
• Building out our offering around data modeling. You won’t just work on the data models themselves - you’ll work closely with Product and the wider Engineering team to shape the way we collect data via our trackers to build better data models, and drive what data model tooling we provide as part of our commercial offering as well
• Building and optimizing real-time and batch data pipelines that power personalization, recommendation engines, and predictive models — from streaming ingestion and transformation using Benthos, to materializing features for agentic use cases and customer-facing AI systems
• Supporting our prospect/customer facing teams by showcasing the possibilities with Snowplow data, such as powering personalisation and recommendation systems, or developing advanced models (marketing attribution, lifetime value, etc.)
• Being an active part in decision making on what we build to help our customers get more value out of Snowplow, and how we deliver it. You’ll bring a different perspective and we’ll want your input!
• Responsible for developing and productizing data models, focusing on scalability, performance and maintainability, and developing in-depth understanding of cloud data warehouses and common web and mobile analytics use cases

Preferred Qualifications

• You document and communicate clearly. Some experience with technical content writing would be a plus
• You are excited to work autonomously. You are able to drive technical initiatives from discovery until to the delivery phase
• You know we can’t do everything today. You’ll be pragmatic and balance our speed of delivery with our commitment to providing a reliable and trusted service to customers
• You want to join a remote team that depends on expert collaborators to work effectively. You’ll be a great communicator and enjoy working closely with the team

Benefits

• A competitive package, including share options
• Flexible working
• A generous holiday allowance no matter where you are in the world
• MacBook and home office equipment allowance
• Enhanced maternity, paternity, shared parental and adoption leave