Senior Data Engineer

Summary

Join 3Pillar as a Senior Data Engineer and contribute to building and maintaining robust data ingestion pipelines. You will develop, maintain, and enhance ETL pipelines, craft high-quality client code, and provide accurate project status updates. This role requires strong proficiency in Python, AWS technologies, and SQL/NoSQL databases, along with experience in data engineering principles and data warehousing. The ideal candidate will possess excellent communication and collaboration skills and a deep understanding of data security and privacy best practices. 3Pillar offers a flexible work environment, global team collaboration, wellness programs, and opportunities for professional development.

Requirements

• Minimum 5 years of experience in data engineering or a related field
• Strong proficiency in Python programming language
• Deep understanding of AWS services, including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda
• Experience with data ingestion pipelines, ETL processes, and data warehousing concepts
• Proficiency in SQL and NoSQL databases
• Experience with data modeling and schema design
• Strong problem-solving and analytical skills
• Excellent communication and collaboration skills
• Experience with data security and privacy best practices

Responsibilities

• Develop, Maintain and Enhance ETL Pipelines
• Craft client code that is not just efficient, but also performant, testable, scalable, secure, and of the highest quality
• Provide accurate status tracking, reporting, and estimation using project methods and tools
• Gather requirements, validate their understanding amongst the team, create and maintain relevant documentation
• Execute activities within current methodology and upholding the highest quality standards
• Foster collaboration with fellow engineers, designers, and managers to comprehend user pain points and iterate on solutions that drive client success
• Take ownership of projects, from technical design to a successful launch

Benefits

• Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach
• You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams
• We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best
• Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries