Senior Azure Data Engineer

Summary

Join Xebia, a global leader in digital solutions, and become a key member of our team. We are seeking a skilled Data Engineer with extensive experience in Azure Data Factory, Databricks, and Big Data technologies. You will be responsible for designing, building, and deploying at-scale infrastructure, developing architecture patterns for data processing, and collaborating with data scientists. This role requires strong SQL and Python skills, experience with data transformation tools, and a proven track record in data engineering or software development. The ideal candidate will have a minimum of 5 years of relevant experience and be ready to work within specified hours. Xebia offers a dynamic work environment and opportunities for professional growth.

Requirements

• Be ready to start immediately
• Be open to work every day between 7 a.m. and 3 p.m. CET
• Have 3+ years’ experience with Azure Data Factory and Databricks
• Have 5+ years’ experience with data engineering or backend/fullstack software development
• Possess strong SQL skills
• Have Python scripting proficiency
• Have experience with data transformation tools - Databricks and Spark
• Have experience in structuring and modelling data in both relational and non-relational forms
• Have experience with CI/CD tooling
• Have working knowledge of Git
• Possess good verbal and written communication skills in English
• Work from the European Union region and have a work permit

Responsibilities

• Be responsible for at-scale infrastructure design, build and deployment with a focus on distributed systems
• Build and maintain architecture patterns for data processing, workflow definitions, and system to system integrations using Big Data and Cloud technologies
• Evaluate and translate technical design to workable technical solutions/code and technical specifications at par with industry standards
• Drive creation of re-usable artifacts
• Establish scalable, efficient, automated processes for data analysis, data model development, validation, and implementation
• Work closely with analysts/data scientists to understand impact to the downstream data models
• Write efficient and well-organized software to ship products in an iterative, continual release environment
• Contribute and promote good software engineering practices across the team
• Communicate clearly and effectively to technical and non-technical audiences
• Define data retention policies
• Monitor performance and advise any necessary infrastructure changes

Preferred Qualifications

• Have experience with Azure Event Hubs, CosmosDB, Spark Streaming
• Have familiarity with data visualization tools (PowerBI, Tableau etc.)
• Have experience in Aviation Industry and Copilot