Data Engineer

Summary

Join Amber Labs, a cutting-edge technology consultancy, as a Data Engineer. This remote contract role requires strong AWS, EMR, Python, and PySpark expertise and experience in the public sector and consulting. You will design, build, and optimize data pipelines, collaborating with cross-functional teams. The ideal candidate is a self-starter with excellent communication skills and a proven track record in delivering data solutions. This position offers a flexible work environment, private medical insurance, a company pension plan, and generous paid time off.

Requirements

• Strong experience with AWS EMR and other AWS data services (Glue, S3, Lambda, Redshift, Athena, etc.)
• Proficiency in Python and PySpark for big data processing
• Hands-on experience working with distributed computing frameworks such as Spark
• Ability to take ownership of tasks, work autonomously, and engage confidently with stakeholders
• Previous experience working on government or public sector projects
• Proven track record of working in client-facing consulting roles, delivering solutions to complex business challenges
• Strong analytical and troubleshooting skills, with the ability to work under pressure in a fast-paced environment

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using AWS EMR, Python, and PySpark
• Build and manage scalable data processing solutions on AWS, leveraging services such as S3, Lambda, Glue, and Redshift
• Work with large-scale datasets in distributed computing environments, ensuring high performance and efficiency
• Develop scripts to automate data ingestion, transformation, and validation processes
• Work closely with clients, data scientists, and business analysts to understand requirements and deliver solutions that meet business needs
• Provide strategic guidance on best practices in data engineering and analytics within the public sector
• Implement data validation, monitoring, and governance best practices to ensure data integrity and compliance

Preferred Qualifications

• Experience with Terraform, Kubernetes, or Docker for infrastructure automation
• Knowledge of SQL, NoSQL databases, and data warehousing solutions
• Familiarity with data security, governance, and compliance in the public sector

Benefits

• Flexible work environment focused on deliverable outcomes
• Private medical insurance through Aviva
• Company pension plan through Nest
• 25 days of annual leave plus UK bank holidays
• Access Perkbox, a global employee rewards platform offering discounts, perks, and wellness resources
• Generous employee referral program
• Highly collaborative and collegial environment with opportunities for career advancement
• Encouraged to take bold steps and embrace a mindset of experimentation
• Choose your preferred device, PC or Mac