Azure Data Engineer

Summary

Join Nagarro, a rapidly growing digital product engineering company, and become a key member of the Business Analytics & Insights (BAI) team. You will collaborate with cross-functional teams to deliver high-quality data solutions across various domains. This role involves designing and implementing scalable data pipelines using Azure Databricks and Data Factory, ensuring data quality and integrity. You will leverage your expertise in data modeling, PySpark, SQL, and Azure components to build efficient data ingestion frameworks. The ideal candidate possesses 3-5 years of IT experience, including at least 3 years with Azure Databricks, and strong problem-solving and communication skills.

Requirements

• 3 to 5 years of IT experience
• Minimum of 3 years of experience working with Azure Databricks
• Expertise in Data Modeling and Source System Analysis
• Proficiency with PySpark
• Mastery of SQL
• Knowledge of Azure components: Azure Data Factory, Azure Data Lake, Azure SQL DW, and Azure SQL
• Experience with Python programming for data engineering purposes
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows
• Experience with data visualization and exploration tools

Responsibilities

• Be part of the technical plan for the migration, including data ingestion, transformation, storage, and access control within Azure’s Data Factory and data lake
• Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks
• Develop scalable and reusable frameworks for data ingestion
• Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms
• Work with event-based and streaming technologies to ingest and process data
• Provide support to the team, resolving technical challenges or issues during the migration and post-migration phases
• Stay current with advancements in cloud computing, data engineering, and analytics technologies, recommending best practices and industry standards for implementing data lake solutions

Preferred Qualifications

• Strong problem-solving capabilities, able to translate business requirements into data science solutions
• Excellent communication skills, with the ability to explain complex concepts to both technical and non-technical stakeholders
• Strong team player with excellent interpersonal and collaboration skills
• Ability to deliver high-quality results within specified timelines