Senior Python Engineer

Summary

Join Acryl Data, the company behind DataHub, an AI & Data Context Platform used by over 3,000 enterprises. As a Python engineer, you will lead the development of DataHub's ingestion framework, connecting diverse data systems and powering metadata collection. You will build scalable, fault-tolerant ingestion systems, clean APIs for the connector ecosystem, and event-driven architectures for real-time metadata processing. This role requires 4+ years of experience building production-grade distributed systems and advanced Python expertise. The position offers a competitive salary ($225,000 to $300,000), equity, comprehensive medical benefits, a remote-friendly work environment, and more. The work location is in the Bay Area (hybrid, 3 days in Palo Alto office).

Requirements

• 4+ years building production-grade distributed systems
• Advanced Python expertise with a focus on API design
• Experience with high-scale data processing or integration frameworks
• Strong systems knowledge and distributed architecture experience
• A track record of solving complex technical challenges

Responsibilities

• Build scalable, fault-tolerant ingestion systems for enterprise-scale metadata
• Build clean, intuitive APIs for our connector ecosystem
• Build event-driven architectures for real-time metadata processing
• Build schema mapping between diverse systems and DataHub's unified model
• Build versioning systems for AI assets (training data, model weights, embeddings)

Preferred Qualifications

• Experience with DataHub or similar metadata/ETL frameworks (Airflow, Airbyte, dbt)
• Open-source contributions
• Early-stage startup experience

Benefits

• Competitive salary
• Equity
• Medical, dental, and vision insurance (99% coverage for employees, 65% coverage for dependents; USA-based employees)
• Carrot Fertility Program (USA-based employees)
• Remote friendly
• Work from home and monthly co-working space budget