Remote Senior Data Engineer-Scala

Summary

Join Thoughtworks and thrive as a Senior Data Engineer, developing modern data architecture approaches to meet key business objectives and providing end-to-end data solutions.

Requirements

• Advanced/fluent english level for daily conversation
• Experience with Scala programming language
• Experience with Spark and distributed computing
• Hands-on experience of data modeling and modern data engineering tools and platforms
• Experience in writing clean, high-quality code using the preferred programming language
• Built and deployed large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting
• Experience with data visualization techniques and can communicate the insights as per the audience
• Experience with data-driven approaches and can apply data security and privacy strategy to solve business problems
• Experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.)

Responsibilities

• Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
• Develop intricate data processing pipelines, addressing clients' most challenging problems
• Collaborate with data scientists to design scalable implementations of their models
• Write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines
• Use different distributed storage and computing technologies from the plethora of options available
• Develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack
• Collaborate with the team on the areas of data governance, data security and data privacy
• Incorporate data quality into your day-to-day work

Benefits

Remote work