Remote Senior Software Engineer, ML Infrastructure

Summary

Join DeepScribe as a Senior Software Engineer for the ML Infrastructure team and contribute to building core platforms & infrastructure that power DeepScribe’s AI stack.

Requirements

• Have 5+ years experience in building and scaling performant software infrastructure
• Have a track record of deploying ML models and have familiarity of the full lifecycle of model development
• Be an effective team player and communicator, and be able to work across functions to find effective solutions

Responsibilities

• Develop and optimize infrastructure for audio processing, transcription, and LLM orchestration, ensuring scalability, reliability, and performance
• Build and maintain core inference infrastructure, including model serving pipelines for transcription and document generation
• Collaborate with product and AI engineering teams to integrate ML models into scalable, production-grade systems
• Design and manage infrastructure as code (IaC) using tools like Terraform to automate and standardize deployment and infrastructure management
• Leverage AWS services (e.g., EC2, Lambda, S3, EFS) to support high-availability, low-latency ML pipelines and processing systems
• Implement and maintain monitoring, alerting, and logging for production infrastructure, ensuring system reliability and quick issue resolution
• Ensure security best practices are enforced across ML infrastructure, with a focus on data protection, role-based access, and compliance with HIPAA & SOC-2

Benefits

• $150,000 to $220,000 annual salary
• Meaningful equity stake in the company
• Flexible PTO
• Work from home stipend
• Medical, Dental, Vision, 401K and other benefits are also offered