Data Engineer

Summary

Join European Dynamics as a Data Engineer (Snowflake) and work remotely as an expert. You will collaborate with a major client’s IT team. Your responsibilities include designing and developing data pipelines using Snowflake and Azure Data Factory, integrating data from various sources, ensuring data consistency and integrity, transforming raw data into usable formats, implementing data quality checks, establishing data governance, and monitoring and tuning data systems. This role requires a university degree in IT or a relevant field, at least five years of relevant experience (three years in managing data solutions), proficiency in modern data architectures and tools, hands-on experience with Apache technologies, and expertise in ETL languages/tools and database technologies. Excellent English is essential. European Dynamics offers competitive remuneration, either on a contract basis or with a full benefits package.

Requirements

• University degree in IT or relevant discipline, combined with a minimum of five years' relevant experience in Information Technology, of which at least three years should have been in managing the development or deployment of data analysis, management, and integration solutions
• Proficiency in the design and implementation of modern data architectures and concepts such as cloud services (AWS, Azure, GCP) and modern data warehouse tools (Snowflake)
• Hands-on experience with Apache technologies such as Kafka, Airflow, and Spark to build scalable and efficient data pipelines
• Hands-on experience designing, building, and deploying data solutions that capture, explore, transform, and utilize data to support AI, ML, and BI
• Expert in ETL languages/tools such as Python, SQL, R, SAS, or Excel
• Expert with database technologies such as SQL, NoSQL, Oracle, Hadoop, or Teradata
• Excellent command of the English language

Responsibilities

• Designs and develops Snowflake and Azure Data Factory data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems
• Integrates data from different sources, including cloud and on-premise SQL and Oracle databases, data warehouses, APIs, and external systems
• Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed
• Transforms raw data into a usable format by applying data cleansing, aggregation, filtering, and enrichment techniques
• Implements data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data
• Establishes the governance of data and algorithms used for analysis, analytical applications, and automated decision-making
• Monitors and tunes data systems, identifies and resolves performance bottlenecks, and implements caching and indexing strategies to enhance query performance

Benefits

We offer a competitive remuneration (either on contract basis or remuneration with full benefits package), based on qualifications and experience