Data Engineer - Python

Summary

Join 3Pillar Global as a Data Engineer and contribute to cutting-edge data analytics projects. You will be responsible for understanding business requirements, writing code, creating data pipelines, ensuring data quality, and collaborating with a team. This role requires expertise in data engineering, SQL, Python, ETL processes, cloud platforms (GCP and AWS), and CI/CD. Preferred qualifications include experience with AI/ML, Looker Studio, and other data visualization tools. 3Pillar offers a flexible work environment, global team opportunities, focus on well-being, and career development.

Requirements

• Demonstrated expertise with a minimum of 3+ years of experience as data engineer or similar role
• Advanced SQL skills and experience with relational databases
• Strong Python skills with hands-on experience on Panda, NumPy and other data-related libraries
• Strong exposure to write ETL / pipeline code
• Experience in Data collection from multiple sources and integrating based on business needs
• Experience in working with Google Cloud Platform and Amazon Web Services
• GCP: Cloud Functions, Cloud Storage, Dataform, etc
• AWS: ECS, Lambda, EC2, S3, etc
• GitHub Actions for CI/CD, workflows
• Terraform
• Proficiency in the English language

Responsibilities

• Understanding the business requirements
• Writing code and implementing the proposed solutions
• Creating data pipelines, versioning and change management
• Manage the complexity inherent in versioned data pipelines
• Building and maintaining ETL processes
• Logging and instrumentation of pipelines and services
• Ensuring data quality
• Strong debugging skills to analyze and fix a defect in the data processing
• Should be a good team player and a great collaborator

Preferred Qualifications

• Exposure to AI / ML
• Exposure to Looker Studio, Tableau, PowerBI
• Experience in working with: Looker Enterprise
• Google Analytics
• Google Tag Manager
• Firebase
• Salesforce
• Hightouch
• Datadog

Benefits

• Imagine a flexible work environment – whether it's the office, your home, or a blend of both
• From interviews to onboarding, we embody a remote-first approach
• You will be part of a global team , learning from top talent around the world and across cultures, speaking English everyday
• Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams
• We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing
• Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best
• Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries