Lead Data Engineer

Summary

Join Thoughtworks as a Lead Data Engineer to develop modern data architecture approaches, lead data engineering projects, and provide end-to-end data solutions. You will collaborate with stakeholders, design technical solutions, and work with cross-functional teams.

Requirements

• Have experience in leading the system design and implementation of technical solutions
• Have a deep understanding of data modeling and experience with modern data engineering tools and platforms
• Have experience in writing clean, high-quality code using the preferred programming language
• Have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Have experience with data visualization techniques and can communicate the insights as per the audience
• Have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
• Have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)

Responsibilities

• Lead and manage data engineering projects from inception to completion
• Collaborate with stakeholders to understand their strategic objectives and identify opportunities to leverage data and data quality
• Design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
• Create, design and develop intricate data processing pipelines
• Collaborate with data scientists to design scalable implementations of their models
• Write clean and iterative code based on TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Lead and advise clients on how to use different distributed storage and computing technologies
• Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
• Be responsible for data governance, data security and data privacy to support business and compliance requirements
• Define the strategy for and incorporate data quality into your day-to-day work

Benefits

No one-size-fits-all career path; ability to develop your career in the way you want