Spiritual Data is hiring a
Senior Data Engineer

Summary

Join Altimate AI as a Senior Data Engineer and contribute to revolutionizing enterprise data operations through the power of AI. As a key member of our team, you will play a crucial role in enhancing our AI capabilities, developing high-performance data systems, and integrating advanced AI using the product into thousands of data teams' daily workflows.

Requirements

• 8+ years of experience in data engineering, with a focus on building scalable data pipelines and systems
• Strong proficiency in Python and SQL
• Extensive experience with SQL query profiling, optimization, and performance tuning, preferably with Snowflake
• Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column-level lineage and dynamic ETLs
• Experience in building data pipelines using Airflow or dbt

Responsibilities

• Building PB Scale Data Pipelines: Building highly performant large scale data infrastructure that can scale to 100K+ jobs and handle PB scale data per day
• Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment
• Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking

Benefits

• Competitive salary and equity
• Base Salary Range: $60,000 - $120,000 [influenced by your expertise, where you live, how the interview goes, and how well you match the role]
• Equity: 0.0% - 0.4%
• Extensive professional development opportunities and resources for continuous learning