Senior Data Engineer

Summary

Join Quanata's exceptional team as a Senior Data Engineer and contribute to creating innovative context-based insurance solutions. As a well-rounded professional, you will develop streaming data pipelines, APIs, and data warehouses, collaborating with cross-functional teams to design optimal data models and schemas.

Requirements

• Bachelor's degree in Computer Science, Information Systems, or a related field, or relevant experience
• Eight or more years experience in software development
• Deep understanding of Python
• Familiarity with terraform
• Experience with streaming data pipelines
• Experience with AWS
• Familiar with architecture principles in distributed solutions
• Experience with pipeline tools such as AWS Step Functions or Airflow and building extensive data integrations
• Knowledge and experience with data governance practices
• Extensive experience with SQL and databases such as Postgres
• Experience working with rest services and APIs
• Strong software testing, data science testing, and data quality background
• Understanding of data science modeling processes and technologies such as Pandas and Scikit learn
• Strong communication and collaboration skills
• Experience with streaming data ingestion and processing using tools like Kafka or AWS Kinesis
• Experience building scalable and resilient systems
• Understanding of data modeling techniques

Responsibilities

• Partner with data science teams to implement solutions while designing for operational non functional requirements such as reliability, scalability, and maintainability
• Implement data quality checks and data governance processes to maintain data accuracy, consistency, and compliance
• Document technical specifications, data flows, and system configurations for collaborative design and future reference
• Collaborate with cross-functional teams to understand data requirements and design optimal data models and schemas
• Develop and implement data pipelines, integrating diverse data sources into Snowflake using appropriate ETL/ELT tools and techniques

Preferred Qualifications

• Extensive CI/CD experience
• Experience with Snowflake and DBT with ETL data pipelines

Benefits

• Medical, dental, vision, life insurance and supplemental income plans for you and your dependents
• Headspace app subscription
• Monthly wellness allowance
• 401(k) Plan with a company match
• Four weeks of PTO in the first year of employment
• Twelve weeks of fully paid parental leave within one year after the birth and/or adoption of a child
• Up to $5000 each year for professional learning, continuing education and career development
• Udemy subscriptions
• Access to multiple different coaching opportunities through BetterUp