Lead Data Engineer

Summary

Join CapTech as a Data Engineering Consultant and become a trusted advisor to clients, designing and implementing modern data pipelines using cloud technologies. You will collaborate with teams to deliver optimal solutions, leveraging your expertise in ETL technologies, cloud-based data warehousing, and SQL/NoSQL databases. This role requires 5+ years of experience in data engineering on cloud platforms and proficiency in various programming languages. CapTech offers a comprehensive benefits package including generous PTO, health coverage, disability insurance, paid family leave, remote work flexibility, and various professional development opportunities.

Requirements

• Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets
• 5+ years of experience delivering data engineering solutions on cloud platform
• 5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)
• Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
• Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
• 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery)
• Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)
• 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
• Familiarity with one or more DevOps tools (git, Jenkins, CI/CD, Jira)
• Fundamental understanding of big data, open source, and data streaming concepts
• Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs
• Experience providing technical leadership and mentoring other engineers in data engineering space

Responsibilities

• Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions
• Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies
• Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution
• Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs
• Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders

Preferred Qualifications

Cloud certification on any platform a plus

Benefits

• Generous PTO
• Health coverage
• Disability insurance
• Paid family leave
• CapFlex – Employee-first mentality that supports a remote and hybrid workforce and empowers daily flexibility while servicing our clients
• Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
• Modern Health –A mental health and well-being platform that provides 1:1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
• Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care
• Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
• Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
• Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities
• 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness