Senior Aws Data Engineer

Summary

Join Xebia, a global leader in digital solutions, and become a Data Engineer specializing in large-scale infrastructure design and deployment. You will build and maintain architecture patterns for data processing, translate technical designs into code, and establish automated processes for data analysis. This role requires strong experience with AWS, SQL, Python, and big data technologies. You will collaborate with data scientists and stakeholders, ensuring efficient and well-organized software delivery. The position requires 5+ years of data engineering experience and fluency in English. Work is based in the European Union.

Requirements

• Be available to start immediately
• Be ready to work with the US Timezone (up to 9 PM CET)
• Have 5+ years’ experience as a data engineer
• Have 2+ years' experience with AWS
• Possess strong SQL skills
• Have Python scripting proficiency
• Have hands-on experience in building data processing pipelines
• Have experience in structuring and modelling data in both relational and non-relational forms
• Possess strong expertise in cloud data platforms/warehouses like Databricks or Snowflake
• Have extensive experience in big data engineering on a terabyte scale, including streaming technologies and near-real-time processing
• Have experience working with VCS like Git
• Have excellent command of oral and written English
• Have the ability to work with different stakeholders and drive consensus within the team
• Possess good verbal and written communication skills in English
• Work from the European Union region and a work permit are required

Responsibilities

• Be responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems
• Build and maintain architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies
• Evaluate and translate technical design to workable technical solutions/code and technical specifications at par with industry standards
• Drive creation of re-usable artifacts
• Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
• Work closely with analysts/data scientists to understand impact to the downstream data models
• Write efficient and well-organized software to ship products in an iterative, continual release environment
• Contribute and promote good software engineering practices across the team
• Communicate clearly and effectively to technical and non-technical audiences
• Define data retention policies
• Monitor performance and advise any necessary infrastructure changes

Preferred Qualifications

• Have proficiency in designing and implementing ETL/ELT processes and data integration workflows using tools like Apache Airflow, AWS Glue
• Have understanding of big data and DevOps technologies (Kafka, Spark, Helm, Terraform)
• Have experience in CI/CD for the data environment
• Have experience in testing for data processing
• Have ML models operationalization (e.g., in Docker, Kubernetes)