Senior Data Engineer

Summary

Join Talon.One's expanding Data team as a Senior Data Engineer / Data Ops and take ownership of all engineering tasks related to infrastructure, data ingestion, and DWH pipelines. You will manage data ingestion workflows (currently based on a Kafka stream), ensure live data ingestion from PostgresDB instances into BigQuery, and manage the overall DWH infrastructure. Responsibilities include writing DWH pipelines, improving DWH code, collaborating with the data team and other stakeholders, and assisting in data modeling. The ideal candidate possesses 3-5 years of experience in Data Engineering/Data Ops, familiarity with the modern data stack, and experience with various tools and technologies such as Kafka, Airflow, DBT Core, BigQuery, and Kubernetes. The role offers a collaborative team environment, opportunities for professional development, and a comprehensive benefits package.

Requirements

• 3 -5 years of experience in the Data Engineering / Data Ops field, ideally working on some big data warehouse projects
• You are familiar with the modern data stack and are able to recommend, set up and maintain all different kinds of components from Data ingestion to automation
• You have experience with a wide range of tools and technologies within the modern data stack: Kafka, Airflow, DBT Core, BigQuery, Lambda functions etc
• You have experience with general infrastructure / DevOps management technologies: Kubernetes, Docker, Postgres, GCP etc
• You always thrive for applying data engineering best practices: consistency checks, testing data reliability, monitoring on top of ingestion pipelines, no double business logic in the code

Responsibilities

• Own the data ingestion streams for all of our client’s DBs, from Postgres to BigQuery
• Own the overall data infrastructure: set up, maintain and improve our stack with new technologies for more efficiency and best practices. E.g. advanced DWH pipeline scheduling
• Write DWH pipelines and improve our overall DWH code to apply best practices and bring more efficiency
• Be part of a data team composed of various profiles, be at the center of all infrastructure decisions and work closely with other stakeholders from the R&D department, especially the DevOps team

Benefits

• 60+ team of engineers, product managers and product designers in Berlin
• Leaders with 8+ years of experience building our promotions engine
• Learning budget and LinkedIn Learning
• 30 vacation days
• Remote-work abroad up to 90 days
• In-house German language courses
• Discounted Urban Sports Club membership and BVG ticket
• Work-Dog-Balance, your best friend is more than welcome!
• Mental health support with Nilo.health