Data Engineer

Summary

Join 3Pillar Global, a company recognized for its innovative culture and award-winning workplace, and contribute to building breakthrough software solutions. As a Data Engineer, you will craft high-quality data pipelines, apply industry-leading design patterns, and actively participate in agile project teams. You will be responsible for integration testing, diagnosing process failures, and collaborating with clients and team members. This role requires a Bachelor's degree in Computer Science or Software Engineering, at least 4 years of relevant experience, and proficiency in various database languages and ETL tools. 3Pillar offers a flexible work environment, global team opportunities, focus on well-being, and career development.

Requirements

• Bachelor’s degree in Computer Science or Software Engineering with a thorough understanding of CS fundamentals and theory relevant to application development
• A minimum of 4 years of experience/expertise in the following areas specified below*
• Oracle PL/SQL OR SQL Server T-SQL OR any equivalent procedural database language
• SSIS OR Datastage OR Informatica OR any equivalent graphical ETL tool
• SQL- candidate should be able to demonstrate mastery
• Industry standard approaches to dev ops, including version control systems (GIT etc.) automated deployment (Jenkins, Azure Devops etc) database deployment tools (Liquibase, MS DACPAC etc)
• Ingesting large volumes of data to a Data Warehouse or Data Lake, from diverse data sources - flat files, various relational databases, web services, JSON, XML etc
• Transforming and loading large volumes of data to a data model adhering to Kimbal design concepts
• Experience in Agile software development methodologies
• Client-facing experience and strong communication skills

Responsibilities

• Craft data pipelines that are accurate, performant, testable, scalable, secure, and generally of the highest quality
• Apply industry-leading design patterns to ensure resilience, traceability, and predictability of the ETL process
• Actively contribute to agile project teams during scrums, sprint planning, and code reviews
• Participate in requirements analysis sessions, technical design, implementation, testing, problem analysis and resolution, and technical documentation
• Responsible for integration testing
• Articulate technical issues to peers, architects and project managers while recommending creative solutions
• Diagnose process failures and data quality issues and devise remediation solutions in a timely fashion
• Client-facing experience and strong communication skills
• Actively participate in accurate planning and estimation efforts, utilizing project methods and tools
• Promote client success across the team by collaborating with engineers, designers, and managers to understand user pain points, anticipate potential problems, and iterate on solutions that drive client success
• Actively participate in the Engineering Practice community, mentoring others through Communities of Practice (CoPs) or on project teams, and supporting the growth of technical capabilities
• Independently drive project delivery within defined architecture, demonstrating autonomy and accountability in all stages from conceptualization to deployment

Preferred Qualifications

Prior experience with Cloud (e.g. AWS) data warehouse platforms (e.g. Redshift) is nice-to-have

Benefits

• Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach
• You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams
• We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best
• Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries