Senior MLOps Engineer

Summary

Join Cohere Health, a rapidly growing clinical intelligence company, as a Senior MLOps Engineer and lead the deployment, management, and optimization of advanced ML models, including LLMs. You will collaborate with cross-functional teams to architect scalable solutions, improve core technologies, and drive the strategic direction of our ML infrastructure. This role requires a blend of technical expertise and leadership skills to elevate our ML operations to the next level.

Requirements

• Master's or Ph.D. (preferred) in Computer Science, Engineering, or a related field
• 5+ years of experience in MLOps, ML Engineering, or related roles
• Proven track record of deploying and managing large-scale machine learning models, especially LLMs
• Deep expertise in programming languages such as Python
• Extensive experience with ML frameworks like TensorFlow or PyTorch
• Experience with cloud platforms (AWS preferred, GCP, or Azure) and containerization technologies (Docker, Kubernetes)
• Strong understanding of CI/CD pipelines, automation tools, and infrastructure as code
• Familiarity with big data technologies (Spark, Hadoop) and distributed computing
• Experience with monitoring and logging tools (e.g. MLFlow, Tensorboard, ELK Stack)
• Exceptional problem-solving skills and the ability to navigate complex technical challenges

Responsibilities

• Define and implement the overall MLOps strategy to support the deployment and scaling of ML models
• Lead the architectural design of ML infrastructure, ensuring scalability, reliability, and efficiency
• Collaborate with leadership to align ML initiatives with business objectives
• Oversee the deployment, scaling, and optimization of LLMs
• Develop strategies to reduce latency and manage costs effectively
• Stay updated on the latest advancements in LLMs and integrate relevant technologies
• Lead the development and improvement of core technology components and system architecture
• Work with engineering teams to ensure seamless integration of ML solutions into products and services
• Evaluate and implement new tools and technologies to enhance the ML infrastructure
• Architect and build automated ML pipelines, including data preprocessing, model training, and deployment
• Implement robust CI/CD pipelines for ML models to facilitate continuous integration and delivery
• Optimize workflows to increase efficiency and reduce time-to-market for ML solutions
• Establish monitoring systems to track model performance, data drift, and system health
• Proactively identify and resolve issues to maintain high availability and reliability of ML services
• Perform regular audits and optimizations to enhance system performance
• Mentor and guide junior ML engineers in MLOps best practices
• Foster a culture of innovation, collaboration, and continuous improvement within the team
• Engage with cross-functional teams to drive cohesive and integrated solutions
• Ensure all ML systems comply with security standards and regulatory requirements
• Implement data governance policies and practices to protect sensitive information

Preferred Qualifications

• Strong understanding of transformer models and advanced NLP techniques
• Working knowledge of infrastructure as code tools (e.g. Terraform)
• Proven leadership skills with experience in mentoring and team development
• Excellent communication skills with the ability to convey complex concepts to non-technical stakeholders
• Experience in the healthcare sector

Benefits

• Health insurance
• 401k
• Bonus