Senior Data Platform Engineer

Summary

Join Propz, a pioneering technology company leveraging Big Data to boost retail sales. We're seeking a Senior Data Platform Engineer to join our team and help us become the leader in next-generation CRM software for retail, handling millions of shoppers across hundreds of clients in Brazil. You will contribute to evolving our data platform architecture, developing large-scale data lakes using Spark, and collaborating with data science and QA teams. This role requires strong Java/Scala skills, experience with Spark, AWS, and relational databases, and excellent problem-solving and communication abilities. We offer a challenging and rewarding environment with various benefits.

Requirements

• Completed higher education in Computer Science, Engineering, Statistics, or related fields
• Experience in data solutions and a strong understanding of Java and/or Scala
• Strong knowledge of Spark software platform, cluster management, and Amazon Web Services Architecture and Testing methodologies, such as TDD solutions, IaaS, and Serverless
• Experience with relational databases such as MySQL, Oracle, or PostgreSQL
• Experience as a technical reference for software development teams, with the ability to provide technical mentoring and knowledge sharing
• Excellent problem-solving skills, critical thinking, and analytical skills
• Excellent communication, collaboration, and interpersonal skills
• Experience with agile methodologies, build automation, and continuous delivery practices
• Advanced English - Necessary for interface with European team

Responsibilities

• Help evolve the data platform architecture to provide a continuous improvement solution for the company's technology strategy needs
• Develop large-scale data lake using Spark
• Design and implement scalable and efficient data solutions to meet business needs
• Collaborate with technical guidance to colleagues
• Collaborate with Data Science and QA teams to define, design, and launch new features to serve models that support intelligence products
• Develop ideal design for high-volume data processes
• Review colleagues' code, provide constructive feedback, and ensure adherence to recommended practices
• Agile participation in ceremonies, regarding the identification and resolution of technical debts
• Stay updated with emerging trends and technologies, bringing new ideas and insights to the team

Preferred Qualifications

• Experience in the development of robust digital products used at scale
• Experience in the development of CRM platforms or marketing tools
• Experience with the transformation of legacy implementations and architectural disruptions

Benefits

• Health and dental plan
• Life insurance
• Meal voucher
• Casual dress code
• Day off on your birthday
• Home office work
• Wellhub