Staff Software Engineer, AI Data Engineering

Summary

Join us as a Staff Software Engineer to build the next generation of distributed data storage and processing systems. You will develop scalable and performant solutions, work across disciplines to shape product strategy, and build systems that scale indefinitely and surpass traditional query performance. You will also mentor and coach engineers and set engineering process standards. This role requires a BS/BTech in a related field and significant experience building highly scalable systems, working with large datasets, and architecting distributed systems. Cloud technologies and CI/CD pipeline experience are also essential.

Requirements

• BS/BTech (or higher) in Computer Science, Engineering or a related field required
• 8+ years of production-level experience as an engineer building highly scalable systems
• 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value
• 4+ years of experience working with SQL or other database querying languages on large multi-table data sets
• Experience architecting, developing, and deploying large-scale distributed systems at scale
• Experience with cloud technologies, e.g., AWS, Azure, GCP
• Experience building continuous integration and continuous development (CI/CD) pipelines
• Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go)

Responsibilities

• Identify and develop scalable and performant solutions
• Work across discipline to shape product strategy and execution
• Develop the foundations of code architecture and quality
• Mentor and coach engineers
• Set and uphold the standard for engineering processes to support high-quality engineering

Preferred Qualifications

• 8+ years of production-level experience as an engineer building highly scalable and reliable infrastructure with at least 3 years focused on AI/ML
• Experience leading large cross functional data initiatives from ideation to implementation , helping share data platform direction,aligning all the teams and driving broader impact across the organization
• Experience building low latency data pipelines that serve structured, semi structured and unstructured data for ML and analytics use cases
• Strong understanding of data modeling, optimization and feature engineering for ML use cases
• Experience building robust data lineage ,auditing, data quality automation standards for AI/ML related systems
• In-depth knowledge of database systems and expertise in data processing frameworks (e.g. Spark, Airflow) and strong python and SQL skills
• Familiarity with  database replication, sharding and other techniques for scalability and high availability of databases