Remote Senior Data Engineer

Logo of Spiritual Data

Spiritual Data

πŸ’΅ $60k-$120k
πŸ“Remote - Worldwide

Job highlights

Summary

Join Altimate AI as a Senior Data Engineer and contribute to revolutionizing enterprise data operations through the power of AI. As a key member of our team, you will play a crucial role in enhancing our AI capabilities, developing high-performance data systems, and integrating advanced AI using the product into thousands of data teams' daily workflows.

Requirements

  • 8+ years of experience in data engineering, with a focus on building scalable data pipelines and systems
  • Strong proficiency in Python and SQL
  • Extensive experience with SQL query profiling, optimization, and performance tuning, preferably with Snowflake
  • Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column-level lineage and dynamic ETLs
  • Experience in building data pipelines using Airflow or dbt

Responsibilities

  • Building PB Scale Data Pipelines: Building highly performant large scale data infrastructure that can scale to 100K+ jobs and handle PB scale data per day
  • Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment
  • Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking

Benefits

  • Competitive salary and equity
  • Base Salary Range: $60,000 - $120,000 [influenced by your expertise, where you live, how the interview goes, and how well you match the role]
  • Equity: 0.0% - 0.4%
  • Extensive professional development opportunities and resources for continuous learning

Share this job:

Disclaimer: Please check that the job is real before you apply. Applying might take you to another website that we don't own. Please be aware that any actions taken during the application process are solely your responsibility, and we bear no responsibility for any outcomes.
Please let Spiritual Data know you found this job on JobsCollider. Thanks! πŸ™