Teachable is hiring a
Senior Data Engineer

Summary

Join Teachable's dynamic, cross-cultural team as a Senior Data Engineer and take the lead on key initiatives, from optimizing our data lake to shaping the future of our events pipeline and ETL processes.

Requirements

• 4+ years of professional experience in data engineering
• Proficiency in processes used in modern data engineering
• Solid understanding of cloud infrastructure
• Hands-on experience with relevant data-related AWS services
• Advanced understanding of the relational data model
• Experience interacting with RESTful APIs and webhooks
• Understanding of DevOps disciplines and Git version control
• A commitment to writing clean, efficient, and maintainable code
• Familiarity with monitoring tools like CloudWatch or New Relic
• Familiarity with incident management tools like PagerDuty is desirable
• Understanding Software Engineering paradigms and lifecycle is desirable
• Proficiency in languages used in data engineering
• Strong SQL skills
• Expertise utilizing Python for data wrangling
• Experience using Airflow for data pipeline orchestration
• Experience with Spark creating big data workloads
• Experience working with Delta Lake, Hudi or Iceberg
• Experience working with large-scale data warehouses like Redshift
• A team player who values diversity and collaboration

Responsibilities

• Partner with Engineering and Product teams on high-impact initiatives
• Design and implement robust data pipelines using AWS services
• Enhance event collection, queueing, and processing mechanisms
• Build and refine meaningful alerts with automated corrective actions
• Troubleshoot and resolve issues, ensuring system reliability and stability
• Architect scalable data products with long-term vision and efficiency in mind
• Identify and resolve complex technical challenges involving system integration, infrastructure, and software bugs