Data Engineer Consultant

Summary

Join Thoughtworks as a Data Engineer and build, maintain, and test software architecture and infrastructure for data applications. Collaborate with team members and data scientists to design and implement data processing pipelines and scalable models. Write clean, iterative code using TDD and continuous delivery practices. Apply various data modeling techniques and incorporate data quality into your work. Leverage the latest big data tools and frameworks, contributing to credible problem-solving and strategic execution. Thoughtworks offers a supportive environment for career development and growth.

Requirements

• Have hands-on experience of data modeling and modern data engineering tools and platforms
• Have experience in writing clean, high-quality code using the preferred programming language
• Have awareness in building data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Have knowledge of data visualization techniques and can communicate the insights as per the audience
• Are aware of data governance, security and privacy strategy to solve business problems
• Have experience with different types of databases (i.e.: SQL, NoSQL, etc
• Understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• Are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• Don’t shy away from risks or conflicts, instead you take them on and skillfully manage them
• Enjoy influencing others and always advocate for technical excellence while being open to change when needed

Responsibilities

• Collaborate with team members to design intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Apply different standard models for big data and create data models for at least one type of modeling technique
• Incorporate data quality into your day-to-day work

Preferred Qualifications

• Proficiency in Python, with knowledge of Java, TypeScript, and Scala as a plus
• Experience with tech stacks such as Databricks, Kubernetes, relational databases, SQL, and Spark
• Experience with the Azure Cloud Platform

Benefits

Learning & Development opportunities