CRODU is hiring a
Senior Data Engineer, Remote - Poland

Summary

The job is for a 3-month remote Senior Data Engineer position to migrate tables from Hive to Unity Catalog using DataBricks. The role requires solid experience as a Data Engineer, good knowledge of DataBricks (especially UCX), Python, Unity Catalog and Hive, data migration experience, Microsoft Azure services, structured and unstructured data handling, interpersonal skills, initiative-taking ability, and fluent English.

Requirements

• Documented solid experience as a Data Engineer
• Good knowledge of DataBricks (especially UCX)
• Good knowledge of Python
• Knowledge of Unity Catalog and Hive
• Experience in data migration
• Experience with Microsoft Azure (e.g., Data Factory, Synapse, Logic Apps, Data Lake)
• Experience with structured and unstructured data
• Interpersonal skills and teamwork abilities
• Ability to take initiative and work independently
• Fluent English

Responsibilities

• Design and perform migration from Hive to Unity Catalog
• Design and develop data environments tailored for the end client (e.g., Microsoft solutions)
• Create project specifications
• Collaborate closely with data engineer, data scientist, architect teams from Poland and USA

Preferred Qualifications

• Experience in designing and optimizing data flow using DBT, SSIS, TimeXtender or similar solutions (ETL, ELT)
• Experience with any big data or NoSQL platforms (Redshift, Hadoop, EMR, Google Data etc.)

Benefits

• Private medical care (Medicover)
• Multisport card for contractors