Senior Data Engineer

Summary

Join GetInData | Part of Xebia, a leading data company, as a Data Engineer. You will design, build, and maintain data architecture and tools for processing large datasets. Collaborate with Platform Engineers on technology selection and develop new functionalities using open-source tools. Implement data intake procedures and ensure compliance with industry standards. Conduct training and knowledge sharing. This role requires proficiency in programming languages like Python, Scala, or Java, experience with Lakehouse platforms (Databricks), dbt, and version control systems (GIT). Extensive experience in Microsoft Azure and knowledge of orchestration tools are also essential.

Requirements

• Proficiency in a programming language like Python / Scala or Java
• Knowledge of Lakehouse platforms - Databricks
• Experience working with dbt
• Familiarity with Version Control Systems, particularly GIT
• Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions
• Extensive experience in Microsoft Azure
• Knowledge of at least one orchestration and scheduling tool, for example, Airflow, Azure Data Factory, Prefect, Dagster
• Familiarity with DevOps practices and tools, including Docker, Terraform, CI/CD, Azure DevOps
• Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement

Responsibilities

• Work together with Platform Engineers to assess and choose the most suitable technologies and tools for the project
• Develop and commit new functionalities and open-source tools
• Execute intricate data intake procedures
• Implement and enact policies in line with the company's strategic plans regarding utilized technologies, work organization, etc
• Ensure compliance with industry standards and regulations in terms of security, data privacy applied in the data processing layer
• Conduct training and knowledge-sharing

Benefits

• Salary: 160 - 200 PLN net + VAT/h B2B (depending on knowledge and experience)
• 100% remote work
• Flexible working hours
• Possibility to work from the office located in the heart of Warsaw
• Opportunity to learn and develop with the best Big Data experts
• International projects
• Possibility of conducting workshops and training
• Co-financing sport card
• Co-financing health care
• All equipment needed for work