Senior AI Product Engineer, Backend

Summary

Join Arize's Backend Engineering team and build highly scalable distributed services powering our leading AI observability platform. You will write performant backend code primarily in Go, Java, and Python, build high-volume analytics systems, and design APIs for ML and LLM workflows. The role involves prototyping, optimizing, and maintaining scalable backend services, contributing to open-source projects, and developing monitoring tools. You'll collaborate with various teams and contribute to building in-house AI agents. This position requires 5+ years of experience with high-performance backend systems and strong programming skills in multiple languages. Arize offers a competitive salary, equity, and a comprehensive benefits package.

Requirements

• 5+ years of experience working with high-performance backend systems
• Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages
• Enthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologies
• Previous work building and operating highly complex SaaS platforms/systems
• Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc

Responsibilities

• Write maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScript
• Build high-volume and highly available analytics systems
• Design and build APIs specific to our customers’ Machine Learning and LLM workflows
• Prototype, optimize, and maintain scalable backend services that power the Arize core platform
• Extend, and contribute back to, open source OLAP databases and distributed message queue frameworks
• Develop and integrate collection tools for robust monitoring of ML and LLM pipelines
• Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment
• Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings
• Contribute to the build our own in-house AI Agents

Preferred Qualifications

• Experience with distributed stream processing - Kafka, Gazette, or similar
• Experience with OLAP systems
• Familiarity with system observability tooling like Prometheus
• Working knowledge of Machine Learning and/or Data Science
• First-hand experience working with large language models (LLMs) or developing AI products

Benefits

• Total compensation also includes a comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellness
• While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces