Senior ETL Developer

Summary

Join StackAdapt's Enterprise Data Office (EDO) as a Staff Data Architect! This role is responsible for the data architecture, pipelines, operations, and platform management of the data lake and enterprise data warehouse. You will assess business requirements, build ingestion pipelines, architect data models, and build data transformation pipelines. Collaboration with BI Engineers is key to ensuring stakeholder needs are met. StackAdapt is a Remote-First company, open to candidates located anywhere in Canada. This position requires significant experience in data engineering and cloud-based data warehouses. The ideal candidate will have a proven track record of success in a similar role.

Requirements

• Minimum 5 years of experience leading data engineering within an Enterprise Data Warehouse environment
• Hands-on experience with cloud-based data warehouses (e.g., Snowflake, BigQuery, Redshift) and bigdata mediums (e.g., Delta Lake, Parquet, Avro)
• Knowledgeable in data warehousing architecture fundamentals (e.g., Kimball/Inmon methodology, dimensional modeling, conformed dimensions, SCDs, etc)
• Proven experience managing cloud-based infrastructure on AWS/AZURE/GCP with knowledge of container technologies such as Kubernetes and networking fundamentals
• Hands-on experience building ETL/ELT data pipelines via custom-coded scripts (e.g., Spark, Python, JAVA, SQL stored procedures) and via integration platforms (e.g., PowerCenter, DataStage, Talend)
• Highly experienced in orchestrating data operations via tools such as Apache Airflow, Cron, Astronomer etc. and administering the data platform via Infrastructure-as-Code (e.g., Terraform)

Responsibilities

• Build reliable data ingestion pipelines to extract data from a variety of data sources including databases (e.g., RDBMS/NOSQL/file stores), applications (via API), flatfiles, etc into the Data Lake with appropriate metadata tagging
• Orchestrate data pipelines via batch, near-real-time, or real-time operations depending on requirements to ensure a seamless and predictable execution
• Advise the team on all data architecture, data modeling, data operations, and data platform decisions
• Support the day to day operation of the EDO pipelines by monitoring alerts and investigating, troubleshooting, and remediating production issues
• Coach and mentor junior and intermediate data engineers and ETL developers as the EDO team grows

Benefits

Remote work