Senior Staff Big Data Engineer

Summary

Join Nagarro, a rapidly growing Digital Product Engineering company, as a Big Data Engineer. You will leverage your 10+ years of experience in big data engineering to design, develop, and maintain cloud-based data systems. This role requires expertise in Spark, Scala, AWS, Snowflake, and other technologies. You will collaborate with teams, mentor colleagues, and solve complex data engineering challenges. A Bachelor's or Master's degree in a related field is required. The position involves writing high-quality code, understanding client needs, and defining technical solutions.

Requirements

• Total experience 10+ years
• Excellent knowledge and experience in Big data engineer
• Strong working experience with architecture and development in Spark, Scala, AWS (EMR, EC2, Lambda, Glue, S3 etc), Architecture and Designing, SQL Server/NoSQL
• Hands on experience in Hadoop, Spark, Scala, SQL and Kafka
• Expertise in AWS and Snowflake, procedures in snowflake orchestrated through Airflow hence working knowledge on Python and Airflow
• Experience with building and maintaining a cloud system
• Familiarity with data modeling, data warehousing, and building distributed systems
• Expertise in Spanner for high-availability, scalable database solutions
• Knowledge of data governance and security practices in cloud-based environments
• Problem-solving mindset with the ability to tackle complex data engineering challenges
• Strong communication and teamwork skills, with the ability to mentor and collaborate effectively
• Bachelor’s or master’s degree in computer science, Information Technology, or a related field

Responsibilities

• Writing and reviewing great quality code
• Understanding the client’s business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements
• Mapping decisions with requirements and be able to translate the same to developers
• Identifying different solutions and being able to narrow down the best option that meets the client’s requirements
• Defining guidelines and benchmarks for NFR considerations during project implementation
• Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers
• Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed
• Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it
• Understanding and relating technology integration scenarios and applying these learnings in projects
• Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken
• Carrying out POCs to make sure that suggested design/technologies meet the requirements