Senior Data Engineer, Data Migration Specialist

Summary

Join our team as a Data Migration Specialist to support a crucial database migration from GCP to Azure using Databricks. This role centers on data extraction, transformation, and loading (ETL) across diverse platforms. You will ensure seamless and dependable migration processes while upholding data quality. The ideal candidate possesses expertise in data ingestion, integration, migration, and cloud-based environments. Responsibilities include data extraction, transformation, integration, quality assurance, migration, testing, and environment management. Success in this position requires strong experience in data migration, ETL processes, and working with various databases and cloud platforms.

Requirements

• Strong experience in data migration, specifically in moving data across platforms (GCP to Azure)
• Expertise in handling ETL processes, particularly using tools like Altova MapForce
• Experience working with databases such as SQL Server
• Familiarity with cloud-based platforms, especially GCP and Azure
• Knowledge of DevOps tools like Bitbucket and Jenkins for CI/CD processes
• Ability to work with various data formats (CSV, screenshots, etc.) and create data mappings between systems
• Strong problem-solving skills with an emphasis on data quality and integrity
• Experience in environment management and administering cloud platforms
• Excellent communication skills to collaborate with clients on data mapping and migration requirements

Responsibilities

• Data Ingestion : Extract data from various source platforms and systems
• Integration : Combine and transform data from multiple sources to ensure consistency and usability
• Data Quality : Ensure the accuracy, completeness, and reliability of the data throughout the migration process
• Migration : Facilitate the movement of data to the destination storage, ensuring proper handling and processing
• Testing : Validate that the processed data meets business requirements and is fit for purpose
• Environment Management : Administer the platforms and tools, ensuring the smooth operation of the migration process and maintaining efficient workflows