Senior Data Engineer

Summary

Join Nagarro, a rapidly growing digital product engineering company, as a highly experienced Data Engineer with Palantir expertise. You will collaborate with cross-functional teams to deliver high-quality data solutions across various domains. Your responsibilities include developing comprehensive technical plans for data migration, ensuring data quality, working with streaming technologies, providing technical guidance, and staying current with industry advancements. This role requires extensive experience in IT, Palantir, cloud computing, data modeling, and various data technologies. Excellent communication and problem-solving skills are essential.

Requirements

• 8 to 10 years of IT experience
• Min. 4 years of experience working with Palantir
• Experience in Cloud (Azure or Google)
• Experience in Data Modelling & Source System Analysis
• Familiarity with PySpark
• Mastery of SQL
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows
• Experience in data visualization/exploration tools
• Providing technical leadership and guidance to teams
• Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions
• Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders
• Strong team player with excellent interpersonal and collaboration skills
• Ability to manage multiple projects simultaneously and deliver high-quality results within specified timelines

Responsibilities

• Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake
• Developing scalable and re-usable frameworks for ingesting of data sets
• Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms
• Working with event based / streaming technologies to ingest and process data
• Provide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phases
• Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution

Preferred Qualifications

Experience preparing data for Data Science and Machine Learning