Remote Senior Data Engineer

Summary

Join Thoughtworks and thrive. Together, our extra curiosity, innovation, passion and dedication overcomes ordinary.

Requirements

• Advanced/fluent english for daily conversation
• Experience with Scala programming language
• Experience with Spark and distributed computing
• Hands-on experience of data modeling and modern data engineering tools and platforms
• Experience in writing clean, high-quality code using the preferred programming language
• Built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Experience with data visualization techniques and can communicate the insights as per the audience
• Experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
• Experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)
• Understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust along the way
• Resilient in ambiguous situations and can adapt your role to approach challenges from multiple perspectives
• Eager to coach, mentor and motivate others and you aspire to influence teammates to take positive action and accountability for their work

Responsibilities

• Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
• Develop intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Use different distributed storage and computing technologies from the plethora of options available
• Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
• Collaborate with the team on the areas of data governance, data security and data privacy
• Incorporate data quality into your day-to-day work

Benefits

Learning & Development: There is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you