Remote Senior Data Engineer

Summary

Join Thoughtworks and thrive as a Senior Data Engineer, building, maintaining, and testing software architecture and infrastructure for managing data applications.

Requirements

• Working with data excites you; You can build and operate data pipelines, and maintain data storage, all within distributed systems
• Have hands-on experience of data modeling and modern data engineering tools and platforms
• Have experience in writing clean, high-quality code using the preferred programming language
• Have built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Have experience with data visualization techniques and can communicate the insights as per the audience
• Have experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
• Have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)
• Understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• Be resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• Don't shy away from risks or conflicts, instead you take them on and skillfully manage them
• Be eager to coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work
• Enjoy influencing others and always advocate for technical excellence while being open to change when needed

Responsibilities

• Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
• Develop intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Use different distributed storage and computing technologies from the plethora of options available
• Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
• Collaborate with the team on the areas of data governance, data security and data privacy
• Incorporate data quality into your day-to-day work