Senior Data Platform Engineer

Summary

Join Alpaca, a leading self-clearing broker-dealer, as a Senior Data Engineer. You will design and develop the data management layer for our platform, ensuring scalability as we grow. Responsibilities include designing ETL patterns, developing scalable transformation layers, maintaining the data lakehouse architecture, and collaborating with various teams. You will work with large datasets (100M+ events/day) and utilize technologies like GCP, Docker, Kubernetes, and Kafka. The role is fully remote. Alpaca offers competitive salary, stock options, health benefits, a home-office setup stipend, and a monthly stipend.

Requirements

• 7+ years of experience in data engineering, including 2+ years of building scalable, low-latency data platforms capable of handling >100M events/day
• Proficiency in at least one programming language, with strong working knowledge of Python and SQL
• Experience with cloud-native technologies like Docker, Kubernetes, and Helm
• Strong hands-on experience with relational database systems
• Experience in building scalable transformation layers, preferably through formalized SQL models (e.g., dbt)
• Ability to work in a fast-paced environment and adapt solutions to changing business needs
• Experience with ETL technologies like Airflow and Airbyte
• Production experience with streaming systems like Kafka
• Exposure to infrastructure, DevOps, and Infrastructure as Code (IaaC)
• Deep knowledge of distributed systems, storage, transactions, and query processing

Responsibilities

• Design and oversee key forward and reverse ETL patterns to deliver data to relevant stakeholders
• Develop scalable patterns in the transformation layer to ensure repeatable integrations with BI tools across various business verticals
• Expand and maintain the constantly evolving elements of the Alpaca Data Lakehouse architecture
• Collaborate closely with sales, marketing, product, and operations teams to address key data flow needs
• Operate the system and manage production issues in a timely manner

Benefits

• Competitive Salary & Stock Options
• Health Benefits
• New Hire Home-Office Setup: One-time USD $500
• Monthly Stipend: USD $150 per month via a Brex Card