Data Engineer

Summary

Join Ryz Labs as a Data Engineer to enhance and stabilize the data monitoring system for a major client. You will build robust, scalable, and proactive alerting workflows to ensure high data quality and reliability. This role involves working with the data engineering team to improve orchestration and monitoring across Snowflake, dbt, Airflow, and AWS services. Key responsibilities include designing and implementing a resilient data monitoring framework, enhancing alerting mechanisms, streamlining orchestration in Airflow, integrating AWS services into the alerting system, collaborating on SLAs and metrics, and documenting the architecture. The ideal candidate possesses strong expertise in Snowflake, dbt, Airflow, and AWS services, along with experience in data monitoring and alerting.

Requirements

• Snowflake: Strong understanding of Snowflake architecture, performance tuning, and metadata management
• Dbt: Experience creating and maintaining dbt models with test coverage and clear documentation
• Airflow: Expertise in managing DAGs, handling retries, and structuring tasks for reliability and visibility
• AWS: Deep familiarity with DMS (Database Migration Service), Kinesis, and Firehose, especially around monitoring and alerting integrations
• Monitoring & Alerting: Experience with data monitoring tools or custom observability frameworks

Responsibilities

• Design and implement a resilient data monitoring framework that improves incident detection and reduces false positives
• Enhance alerting mechanisms for pipeline failures, data anomalies, and data freshness across Snowflake and dbt models
• Streamline orchestration and dependency management in Airflow to increase reliability and improve observability
• Integrate AWS DMS, Kinesis, and Firehose monitoring into our centralized alerting system
• Collaborate with stakeholders to define SLAs and implement meaningful metrics for data health
• Document monitoring architecture and ensure knowledge transfer to internal teams

Preferred Qualifications

Experience with Astronomer is a bonus