Senior Data Engineer

Summary

Join Thoughtworks as a Senior Data Engineer and build, maintain, and test software architecture and infrastructure for data applications. You will develop core capabilities for technical and functional data platforms, acting as an anchor for work streams and ensuring timely delivery. Leveraging the latest big data tools and frameworks, you'll collaborate on problem-solving and strategy execution. You'll design and operate modern data architectures, develop intricate data processing pipelines, and collaborate with data scientists. This role requires expertise in distributed systems, data modeling, and various programming languages, along with strong communication and stakeholder management skills. Thoughtworks offers a supportive culture with numerous development programs to foster career growth.

Requirements

• Advanced English required
• Have experience with GCP cloud
• Build and operate data pipelines, and maintain data storage, all within distributed systems
• Have hands-on experience of data modeling and modern data engineering tools and platforms
• Have experience in writing clean, high-quality code using the preferred programming language
• Have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Have experience with data visualization techniques and can communicate the insights as per the audience
• Have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
• Have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)
• Understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• Be resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• Not shy away from risks or conflicts, instead take them on and skillfully manage them
• Be eager to coach, mentor and motivate others and aspire to influence teammates to take positive action and accountability for their work
• Enjoy influencing others and always advocate for technical excellence while being open to change when needed

Responsibilities

• Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
• Develop intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Use different distributed storage and computing technologies from the plethora of options available
• Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
• Collaborate with the team on the areas of data governance, data security and data privacy
• Incorporate data quality into your day-to-day work

Benefits

• Learning & Development opportunities
• Remote work (#LI-Remote)