Data Platform Engineer

Summary

Join Treatwell's Data Platform team as a Data Platform Engineer and contribute to building and maintaining scalable, secure, and innovative data solutions. You will manage and build data tools, including processing pipelines, streaming mechanisms, and observability tools, ensuring data integrity and efficient CI/CD pipelines. Collaborate with cross-functional teams, utilizing Python and Terraform, and leveraging open-source platforms like Airbyte and AWS services. This role requires expertise in data integration, infrastructure as code, and data warehouse management. You will play a key role in achieving timely, accurate data-driven decisions for Treatwell's analysts, engineers, and business users. The position offers a 100% remote work environment with flexible hours and various other benefits.

Requirements

• Experience with data integration tools (Airbyte preferred), orchestration tools like Airflow, and observability frameworks for logging and alerting
• Proficient in Python, with experience building scalable data tools and adhering to test-driven development and best practices using Docker
• Hands-on experience on Infrastructure as Code (IaC) with Terraform, ideally on AWS
• Familiarity with GitLab CI and enabling complex CI/CD pipelines
• Experience in managing data platform infrastructure, including maintaining Redshift or similar data warehouses, ensuring system reliability and performance, and implementing security best practices
• Familiarity with monitoring and visualisation tools like Prometheus and Grafana for platform observability
• You prioritise creating technical documentation to enhance cross-functional alignment and knowledge sharing
• A strong team player who thrives in Agile, high-performance teams. You excel in articulating complex technical matters clearly to both technical and non-technical stakeholders
• Passionate about contributing to the broader data platform strategy. You align technical initiatives with business objectives and seek opportunities to drive innovation and scalability
• Exceptional problem-solving abilities, with a focus on resolving complex technical issues

Responsibilities

• Collaborate with your team members to build and maintain a scalable, robust data platform and performant data solutions to the entire organisation
• Manage data platform infrastructure and its security
• Manage Redshift Data Warehouse, ensuring smooth running day-to-day performance
• Own platform observability, including health checks, logging, metrics, and alerting for data pipelines and tools
• Measure and improve platform performance by analysing system metrics and implementing feedback-driven enhancements
• Partner with data product managers to address the organisation’s data integration needs
• Support Analytics Engineers for any data / tooling needs this will include
• Ensure transformation tooling (DBT Core) is stable and scalable
• Integrate data from different data sources into Data Warehouse
• Ensure data pipelines are robust and supported with CI/CD abilities
• Build and manage development and production environments
• Align infrastructure design with engineering best practices in collaboration with the Tech Platform team
• Identify and evaluate emerging technologies for platform scalability and long-term growth
• Foster a data-driven culture and approach to decision making
• Collaborate with analytics engineers / software engineers / product managers / stakeholders on cross team projects
• Contribute towards the strategy and direction of the Data Platform

Preferred Qualifications

Familiarity with Kubernetes and using Helm is a nice-to-have

Benefits

• 28-days holiday, plus bank holidays
• Monthly £40 Treatwell vouchers so you can treat yourself too
• Mental health support through our partnership with Plumm
• 100% remote position with flexible working
• Growth funds for you to develop and grow with your team
• All the tools / devices supplied to do the best job you can eg. laptop, monitor, keyboard etc