Senior Software Engineer, AI

Summary

Join UpDoc, a company building a clinically validated, physician-supervised conversational agent for managing chronic diseases, as a Senior Engineer. You will primarily work on the patient-facing conversational agent, a fully remote position. This role requires significant experience in backend web development, LLM applications, and AI infrastructure. You will lead development, implement scalable systems, and collaborate with clinical experts. UpDoc offers competitive compensation and equity in an early-stage startup. The ideal candidate is a senior engineer with a backend focus and a passion for AI/LLM technologies.

Requirements

• 5+ years of professional software development experience, including 2+ years of experience with backend web development
• Experienced and comfortable working with type-hinted, modern Python
• 2+ years of experience building end-to-end LLM applications, personally or professionally
• Experience integrating/optimizing LLMs in production environments
• Knowledge of evaluation frameworks
• Knowledge and experience with MLOps/LLMOps best practices
• Experience building AI infrastructure from 0 -> 1
• Experience with cloud platforms (especially Azure) and containerization technologies

Responsibilities

• Lead the development of our patient-facing conversational agent
• Implement a scalable, low-latency system for voice/multimodal conversations
• Implement rigorous prompt engineering processes and develop useful metrics for system evaluation
• Identify where fine-tuning and alignment might be valuable, and create data pipelines to enable fast experimentation
• Work with other backend engineers to deploy AI models and chat/voice APIs
• Help identify, evaluate, and implement emerging LLM technologies, tools and frameworks
• Collaborate with clinical experts to validate performance and medical accuracy
• Work on developing backend services using FastAPI and Pydantic

Preferred Qualifications

• Professional experience building end-to-end LLM-powered applications
• Experience with model fine-tuning/alignment
• Experience in an early stage startup environment
• Experience with healthcare industry standards, such as FHIR, and regulations, including HIPAA and SOC 2

Benefits

Competitive compensation and equity in an early-stage startup