Associate Principal Big Data Engineer

Summary

Join Nagarro, a rapidly growing Digital Product Engineering company, as a Big Data Engineer with 11+ years of experience. You will leverage your expertise in Databricks, Azure cloud services, and data engineering principles to design, develop, and implement data solutions. Responsibilities include writing high-quality code, translating business requirements into technical designs, and ensuring adherence to best practices. You will collaborate with teams, mentor colleagues, and solve complex data engineering challenges. A Bachelor's or Master's degree in a related field is required. The ideal candidate possesses strong communication and problem-solving skills.

Requirements

• Have 11+ years of total experience
• Possess excellent knowledge and experience in Big data engineer
• Have expertise in Databricks, Azure Synapse, Azure Data Factory, and PySpark
• Have strong working experience with architecture and development in Azure cloud services such as ADF, ADLS, Azure SQL, Logic Apps, and Azure Functions
• Have strong hands-on experience in Databricks and related architecture like Medallion
• Have experience in implementing and delivering data solutions and pipelines on Databricks
• Have a strong understanding of data modeling, data structures, data warehouses, databases, and ETL processes
• Have an in-depth understanding of large-scale data sets, including structured and unstructured data
• Have hands-on experience in SQL
• Have a basic understanding of CI/CD and DevOps
• Have a Bachelor’s or master’s degree in computer science, Information Technology, or a related field
• Possess a problem-solving mindset with the ability to tackle complex data engineering challenges
• Possess strong communication and teamwork skills, with the ability to mentor and collaborate effectively

Responsibilities

• Write and review great quality code
• Understand the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements
• Map decisions with requirements and be able to translate the same to developers
• Identify different solutions and be able to narrow down the best option that meets the client’s requirements
• Define guidelines and benchmarks for NFR considerations during project implementation
• Write and review design document explaining overall architecture, framework, and high-level design of the application for the developers
• Review architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed
• Develop and design the overall solution for defined functional and non-functional requirements; and define technologies, patterns, and frameworks to materialize it
• Understand and relate technology integration scenarios and apply these learnings in projects
• Resolve issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and be able to justify the decision taken
• Carry out POCs to make sure that suggested design/technologies meet the requirements

Preferred Qualifications

• Have GenAI experience
• Have experience with building and maintaining a cloud system
• Be familiar with data modeling, data warehousing, and building distributed systems
• Have expertise in Spanner for high-availability, scalable database solutions
• Have knowledge of data governance and security practices in cloud-based environments