Remote Data Engineer

Summary

Join Amber Labs, a cutting-edge UK and European technology consultancy, as a Data Pipeline Developer to design, develop, and maintain scalable data pipelines, collaborate with cross-functional teams, and work in a flexible and inclusive environment.

Requirements

• AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure
• Terraform
• Databricks
• Data Lake, Warehouse, Lakehouse architecture and design
• Python/Pyspark
• Data platforms and notebooks: Jupyter, Databricks, Azure
• Gitlab: repository and CI/CD

Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines for ingesting, transforming, and loading data from various sources
• Utilize SSIS to create and manage ETL (Extract, Transform, Load) processes for seamless data integration
• Collaborate with data architects and analysts to understand data requirements and implement efficient data models
• Ensure data architecture and models support business needs and are scalable for future growth
• SSIS Expertise: Demonstrate expertise in SQL Server Integration Services (SSIS) for building and managing ETL processes
• Optimize and troubleshoot SSIS packages for performance and reliability
• Implement data quality checks and validations within ETL processes to ensure accurate and reliable data
• Adhere to data governance and compliance standards, ensuring data integrity and security
• Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions

Benefits

• Join a rapidly expanding startup where personal growth is a part of our DNA
• Benefit from a flexible work environment focused on deliverable outcomes
• Receive private medical insurance through Aviva
• Enjoy the benefits of a company pension plan through Nest
• 25 days of annual leave plus UK bank holidays
• Access Perkbox, a global employee rewards platform offering discounts, perks, and wellness resources
• Participate in a generous employee referral program
• A highly collaborative and collegial environment with opportunities for career advancement