Remote Principal Data Engineer
at Twilio

Summary

Join the team as our next Principal Data Engineer and support the People Insights Team in building and maintaining the People Data Warehouse, ensuring seamless data operations and environment optimization.

Requirements

• 8+ years of experience in data management and cloud based infrastructure
• Strong SQL knowledge
• Strong experience with in using Terraform
• Experience with Snowflake
• Expert level knowledge in Python
• Experience working with code repository services such as GitHub or GitLab
• Hands on development experience with Matillion or similar ETL/ELT solution
• Ability to ingest data from various sources such as (Databases, API’s, and SFTP, etc)
• Experience with administering, operating, and maintain AWS infrastructure
• Knowledge of implementing AI/LLM solutions using OpenAI and Llama
• Ability to operate in ambiguity and use creativity to combat challenges with an inherent curiosity about solving problems

Responsibilities

• Work as a member of the People Insights Team to build and maintain the People Data Warehouse
• Manage AWS infrastructure using Terraform
• Use SQL to write and debug complex queries as well as performance tune and manage pre existing scripts in Snowflake
• Develop and maintain Python scripts for data ingestion pipelines
• Build AI/ML models
• Maintain and create new Matillion workflows
• Identify opportunities for environment enhancements