Senior Airflow Reliability Engineer

Summary

Join Astronomer's Customer Reliability Engineering (CRE) team as a Senior Airflow Reliability Engineer and become an Apache Airflow expert. You will provide direct Airflow expertise to customers, ensuring the optimal use of Astronomer's managed Airflow service. CRE is a unique support team requiring strong technical skills and customer empathy. This role involves solving challenging Airflow problems, contributing to side projects, and working directly with customers. The position requires working specific hours (6:30 AM to 12:30 PM IST or 12:30 PM to 6:30 PM IST, Monday to Friday), with flexible hours for the remainder of the workday. The role offers opportunities for professional growth and collaboration within a globally distributed team.

Requirements

• Proven proficiency in Python, with a minimum of 4 years of experience
• 7+ years of professional experience (any industry)
• Experience with Kubernetes/Docker/Containers
• Experience working with a distributed system with any major cloud provider (AWS, GCP, Azure)
• Problem-solving and troubleshooting abilities
• Work well with autonomy and independence
• Good written and verbal communication for connecting with our customers over our ticketing system and through Zoom

Responsibilities

• Learn and build expertise across several software engineering disciplines, including: Airflow and data engineering, Kubernetes, and Cloud Engineering
• Gain exposure to the big picture; learn about product, engineering, customer relationship management, and more
• Solve challenging Airflow problems for our customers. From optimizing configuration to identifying world-first Airflow bugs, you’ll see it all here
• Spend up to 25% of your time on side projects that contribute to Astronomer’s overall success, such as contributing to the open-source Airflow repository or developing Astronomer’s internal monitoring and alerting systems built on Airflow
• Work on a modern, sophisticated, cloud-native product that customers use to connect to dozens of other systems. Gain depth and breadth of learning!
• Work directly with our customers’ data engineers, system admins, DevOps teams, and management
• Provide feedback from your experience that can shape the direction of the Airflow project
• Own the customer experience, working directly with customers to prioritize and solve issues, meet SLAs, and provide “white glove” guidance on the path to production
• Participate remotely within a fully distributed team
• Help maintain 24x7 coverage through a specified 6-hour pager period during your work day
• Participate in paid on-call rotation for weekend coverage

Preferred Qualifications

• Experience in Airflow administration and DAG creation
• Contributions to open-source projects
• Customer Support experience
• Familiarity with SQL and PostgreSQL
• Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools

Benefits

• Flexible hours (outside of the required 6-hour window)
• Remote work
• Paid on-call rotation