Data Engineer II

Summary

Join Teachable's dynamic Data team as a skilled Data Engineer, contributing to data-driven decision-making. You will manage the entire data lifecycle, from ingestion to consumption, focusing on data modeling and supporting various business domains. Collaborate with stakeholders, design and implement data pipelines, and ensure data integrity and relevance. Maintain thorough documentation and work closely with cross-functional teams. This role requires 2+ years of experience in data engineering and proficiency in database languages, ETL/ELT processes, and cloud infrastructure (AWS). Teachable offers a remote-first culture with in-person events.

Requirements

• 2+ years of experience working within Data Engineering, Analytics Engineering, Business Intelligence or similar functions
• Experience in database languages (PostgreSQL, Redshift, S3), indexing and partitioning to handle large volumes of data and create optimized queries and databases, and file manipulation and organization, such as Parquet
• Experience with the "ETL/ELT as code" approach for building Data Marts and Data Warehouses
• Experience with cloud infrastructure (AWS) and knowledge of solutions like Athena, Redshift Spectrum, SageMaker and Apache Airflow for creating DAGs
• Experience with error and inconsistency alerts, including detailed root cause analysis, correction, and improvement proposals
• Critical thinking for evaluating contexts and making decisions about delivery formats that meet the company’s needs (e.g., materialized views, etc.)

Responsibilities

• Data Ingestion to Consumption: Manage the flow of data from ingestion to final consumption. Organize data, understand modern data structures and file types, and ensure proper storage in data lakes and data warehouses
• Data Modeling: Develop and maintain entity-relationship models. Relate business and calculation rules to data models to ensure data integrity and relevance
• Pipeline Implementation: Design and implement data pipelines using preferrable SQL or Python to ensure efficient data processing and transformation
• Reporting Support: Collaborate with business analysts and other stakeholders to understand reporting needs and ensure that data structures support these requirements
• Documentation: Maintain thorough documentation of data models, data flows, and data transformation processes. Documentation also supports knowledge sharing, status updates with non-technical stakeholders
• Collaboration: Work closely with other members of the Data Team and cross-functional teams to support various data-related projects
• Quality Assurance: Implement and monitor data quality checks to ensure accuracy and reliability of data

Preferred Qualifications

Knowledge in Python is a plus

Benefits

• While Teachable maintains our NY office for local employees to use, we operate as a remote-first culture in order to give our employees added flexibility
• In order to maintain connection and create a community beyond the screen, Teachable holds in-person events throughout the year, where employees and teams can come together for bonding, strategic alignment, goal-setting, and celebrations!