Senior Software Engineer, Data Platform

Summary

Join Instacart's Data Platform team as a Senior Software Engineer and be the technical force shaping our data infrastructure. Design, develop, and maintain comprehensive access controls and governance frameworks to protect data integrity and privacy. Elevate data utilization across departments, enabling valuable insights and driving business value. Work on challenging scaling problems while designing features that will define the grocery industry. Collaborate with stakeholders and shape systems from design and technical decisions to execution. Contribute to the Data Strategy and build the platform upon which Instacart's data lake will be built.

Requirements

• Has 5+ years of experience in software engineering
• Exhibits an in-depth understanding of distributed systems, with proven experience with data processing technologies such as DBT and Airflow, and common web frameworks such as Rails
• Proficiently uses SQL for writing and reviewing complex queries for data analysis and debugging
• Can design for scale with the entire system in mind
• Capably communicates and is comfortable seeking and receiving feedback
• Possesses strong analytical and debugging skills
• Takes a strong sense of ownership while working with large codebases and diverse suite of products
• Embraces a collaborative mindset to partner with engineers, designers, and PMs from multiple teams to co-create impactful solutions while supporting system contributions
• Communicates clearly, presents ideas well, and can influence key stakeholders at manager, director, and VP levels

Responsibilities

• Designing, developing, and sustaining the comprehensive access controls and governance systems that improve the integrity and privacy of our data
• Ensuring the reliability, scalability, and security of the data platform
• Collaborating with various stakeholders and actively involve in the data infrastructure

Preferred Qualifications

• Holds a Bachelor’s degree in Computer Science, Software Engineering, or a related field, or can demonstrate equivalent industry experience (4+ years)
• Have prior work experience in Data Platforms
• Hold experience with big data technologies such as Spark, Hadoop, Flink, Hive, or Kafka, and with both streaming and batching data pipelines
• Have proven experience with distributed system designs
• Possess strong general programming and algorithm skills
• Show strong attention to detail and accuracy in your implementation
• Have a strong experience writing complex and optimized SQL queries
• Appreciate a data-driven mindset

Benefits

• Remote work, flexible hours
• Bonuses and incentives
• Equity grants