Data Engineer - Spark & Databricks Specialist

Summary

Join a leading systemic bank as a Data Engineer on a long-term project, contracted through a major Microsoft Partner and collaborating directly with Microsoft. This role offers a unique opportunity to work at the intersection of finance and cutting-edge technology, transforming the bank’s data infrastructure. You will be embedded within the bank’s data organization, reporting to a senior technical leader. The position is remote-first, based in Greece, with occasional on-site meetings in Athens. You will design and implement scalable data pipelines, work with Apache Spark and Azure Databricks, and collaborate with various teams. This is a full-time contractor position with competitive remuneration.

Requirements

• Proven experience in data engineering roles with a focus on Azure technologies
• Hands-on expertise in Apache Spark and Databricks
• Familiarity with Delta Lake and related architectural patterns
• Experience integrating structured and semi-structured data sources
• Proficient in SQL, Spark SQL, and Python
• Exposure to CI/CD pipelines and modern DevOps practices within Azure
• Strong collaboration and communication skills in cross-functional teams

Responsibilities

• Design and implement scalable data pipelines and ingestion processes across Azure cloud environments
• Work with Apache Spark and the Azure Databricks platform to enable large-scale data processing
• Utilize Delta Lake to support data versioning, schema enforcement, and ACID-compliant transactions
• Collaborate with business and technical teams to integrate data from multiple sources including Azure Data Lake and Azure SQL Database
• Perform complex data transformations using DataFrame APIs and Spark SQL
• Develop and manage Delta Live Tables and orchestrate data workflows using Azure Data Factory
• Implement CI/CD workflows within Azure Databricks to streamline development and deployment
• Build SQL-based reporting layers and contribute to dashboard and data visualization development (e.g., Power BI)

Preferred Qualifications

Proficient in Python

Benefits

Remote work, flexible hours