Senior Data Engineer

Summary

Join 3Pillar Global as a Senior Data Engineer and contribute to cutting-edge software development projects. You will build and maintain key engineering blocks, work on ad-hoc R&D projects, and collaborate with various teams. Leverage your expertise in data analytics to deliver high-quality solutions for clients. This role requires strong Python development skills, experience with cloud platforms, and knowledge of big data technologies. 3Pillar offers a flexible work environment, global team collaboration, and a focus on employee well-being.

Requirements

• Python development skills
• Ability to implement ETL data pipelines in Python
• Creating REST APIs
• Advanced SQL scripting knowledge
• Experience with Google Cloud Platform, AWS or Azure
• 2+ years of experience in data or software development
• Knowledge of big data platforms
• Knowledge of relational databases
• Knowledge of technologies: Git, Docker, Bash language
• Ability to propose, design and implement a simple ETL solutions both in batch and real-time
• Understanding of what is a continuous delivery pipeline and ability to design a process
• Ability to pick the correct technology for the correct task

Responsibilities

• Build shippable software following Engineering standards in place
• Build and maintain key Engineering blocks that other teams can rely upon (such as APIs and Big Data implementations)
• Support the current stack and be able to extend it with new features
• Work on ad-hoc R&D projects
• Work closely with TMG’s business intelligence users, operations and development teams on projects and CR’s, encouraging a data driven and pragmatic approach to tackling challenges and problems
• Ensure the deliveries are on time and of the required quality
• Maintain the company’s data assets at required quality levels
• Help to design and build solid, efficient, stable APIs
• Help to maintain our high standard of code
• Keep up to date with the latest technologies and methodologies
• Ensure a globally robust and highly scalable approach to development to support our growing number of global users and services
• Enforce best practices in terms of code quality and design of processes

Preferred Qualifications

• Experience with DBT (Data build Tools) to develop data pipelines
• Experience with Data streams in Google Dataflow or Apache beam
• Experience using Airflow
• Experience with NoSQL databases like Redis, Elastic Search

Benefits

• Flexible work environment – whether it's the office, your home, or a blend of both
• Part of a global team , learning from top talent around the world and across cultures, speaking English everyday
• Well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off
• Professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries