Consultant Data Engineer

Summary

Join Thoughtworks as a Data Engineer and build, maintain, and test software architecture and infrastructure for managing data applications. Collaborate with team members to design data processing pipelines, work with data scientists on scalable model implementations, and write clean, iterative code using TDD and continuous delivery practices. Apply various big data models, create data models, and incorporate data quality into your work. You will liaise between clients and stakeholders, ensuring buy-in and trust. Thoughtworks offers a supportive environment with numerous development programs and opportunities for career growth.

Requirements

• Have hands-on experience of data modeling and modern data engineering tools and platforms
• Have experience in writing clean, high-quality code using the preferred programming language
• Have awareness in building data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Have knowledge of data visualization techniques and can communicate the insights as per the audience
• Are aware of data governance, security and privacy strategy to solve business problems
• Experience in Databricks and Oracle DBMS
• Experience with any cloud provider
• Have experience with different types of databases (i.e.: SQL, NoSQL, etc.)
• Understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• Are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• Don’t shy away from risks or conflicts, instead you take them on and skillfully manage them
• Enjoy influencing others and always advocate for technical excellence while being open to change when needed

Responsibilities

• Collaborate with team members to design intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Apply different standard models for big data and create data models for at least one type of modeling technique
• Incorporate data quality into your day-to-day work

Benefits

• There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you
• Your career is supported by interactive tools, numerous development programs and teammates who want to help you grow