Senior Backend Engineer

Summary

Join OpenPhone, a leading VoIP provider, and contribute to the development of cutting-edge AI-powered communication solutions. We are a fast-growing, fully remote company backed by top-tier investors. In this role, you will design and integrate LLM-based solutions, focusing on RAG implementations and optimal architecture. You will lead experimentation, optimize AI costs, and collaborate with cross-functional teams. We offer a competitive salary, equity, extensive medical coverage, a monthly lifestyle stipend, and flexible PTO. If you thrive in a fast-paced environment and are passionate about AI, we encourage you to apply.

Requirements

• 5+ years of backend engineering experience with TypeScript/Node.js or Python
• Experience with LLM integrations (OpenAI, Anthropic, Azure OpenAI) and familiarity with orchestration frameworks like LangChain or LlamaIndex
• Experience/familiarity with real-time event-driven and streaming systems
• Working knowledge of prompt engineering, RAG, and vector databases
• Experience with API design and microservices architecture
• Track record of rapid prototyping and experimentation
• Strong cross-functional collaboration and communication skills

Responsibilities

• Design and integrate LLM-based solutions, focusing on RAG implementations and optimal architecture patterns
• Lead rapid experimentation and prototyping of AI features, conducting proof of concepts to validate solutions
• Drive cost optimization for AI implementations through efficient architecture design
• Work closely with product, engineering, and customer experience teams to develop AI solutions
• Build and optimize prompt engineering workflows to enhance user experiences
• Implement robust error handling and monitoring for AI systems
• Guide technical discussions around AI architecture decisions
• Mentor team members and champion innovation in AI development

Preferred Qualifications

• Experience with conversational AI and voice agent development
• Knowledge of autonomous agent architectures and workflows
• Background in data pipeline design and ETL processes
• Experience building low-latency, real-time AI systems
• Familiarity with AI agent orchestration frameworks
• Understanding of multi-agent systems and communication patterns
• Knowledge of AI system cost optimization

Benefits

• Equity
• Extensive medical coverage
• A monthly lifestyle stipend
• A flexible PTO policy