Consultant Data Engineer

Summary

Join Thoughtworks as a Data Engineer and build, maintain, and test software architecture and infrastructure for managing data applications. Collaborate with team members to design data processing pipelines and with data scientists to create scalable model implementations. Write clean, iterative code using TDD and continuous delivery practices. Apply standard big data models and create data models for at least one modeling technique. Incorporate data quality into daily work. Leverage the latest big data tools and frameworks, and engage in credible problem-solving to execute strategies. Thoughtworks offers a supportive environment for career development with interactive tools and numerous programs.

Requirements

• You have hands-on experience of data modeling and modern data engineering tools and platforms
• You have experience in writing clean, high-quality code using the preferred programming language
• You have awareness in building data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• You have knowledge of data visualization techniques and can communicate the insights as per the audience
• You are aware of data governance, security and privacy strategy to solve business problems
• Experience in Databricks and Oracle DBMS
• Experience with any cloud provider
• You have experience with different types of databases (i.e.: SQL, NoSQL, etc
• You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• You are resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• You don’t shy away from risks or conflicts, instead you take them on and skillfully manage them
• You enjoy influencing others and always advocate for technical excellence while being open to change when needed

Responsibilities

• Collaborate with team members to design intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Apply different standard models for big data and create data models for at least one type of modeling technique
• Incorporate data quality into your day-to-day work

Benefits

• There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you
• Your career is supported by interactive tools, numerous development programs and teammates who want to help you grow