Senior Data Engineer

closed
Spiritual Data Logo

Spiritual Data

πŸ’΅ $60k-$120k
πŸ“Remote - Worldwide

Summary

Join Altimate AI as a Senior Data Engineer and contribute to revolutionizing enterprise data operations through the power of AI. As a key member of our team, you will play a crucial role in enhancing our AI capabilities, developing high-performance data systems, and integrating advanced AI using the product into thousands of data teams' daily workflows.

Requirements

  • 8+ years of experience in data engineering, with a focus on building scalable data pipelines and systems
  • Strong proficiency in Python and SQL
  • Extensive experience with SQL query profiling, optimization, and performance tuning, preferably with Snowflake
  • Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column-level lineage and dynamic ETLs
  • Experience in building data pipelines using Airflow or dbt

Responsibilities

  • Building PB Scale Data Pipelines: Building highly performant large scale data infrastructure that can scale to 100K+ jobs and handle PB scale data per day
  • Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment
  • Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking

Benefits

  • Competitive salary and equity
  • Base Salary Range: $60,000 - $120,000 [influenced by your expertise, where you live, how the interview goes, and how well you match the role]
  • Equity: 0.0% - 0.4%
  • Extensive professional development opportunities and resources for continuous learning
This job is filled or no longer available