Manager, Data Science

Summary

Join MCG, a leading healthcare organization, as a Manager of Data Science and lead a team responsible for testing agents. You will direct annotation, maintain performance metrics, create evaluation packages, and report to stakeholders. This role requires expert Python proficiency, statistical knowledge, and healthcare experience. The position offers a competitive salary, bonus eligibility, and comprehensive benefits, including remote work with occasional travel, medical insurance, retirement plan, paid time off, and parental leave. MCG values diversity and inclusion, fostering a collaborative environment. The ideal candidate will balance independent remote work with in-person collaboration.

Requirements

• Expert level Python proficiency
• Ability to write reliable, extensible python packages
• Demonstrated experience translating high level requirements into useful tools
• Excellent knowledge of frequentist and Bayesian statistical techniques
• Healthcare experience
• Good written communication skills

Responsibilities

• Direct annotation by managing annotation budgets, sourcing data, and providing statistical analysis of annotations
• Maintain and expand metrics used to evaluate agent performance and fairness
• Create evaluation packages for Data Scientist and Machine Learning Engineers to use when running experiments
• Ensure accurate, regular reporting on evaluation metrics to stakeholders
• Manage periodic re-evaluation of production agents using user data and annotation

Preferred Qualifications

• Experience with basic principles of deep learning and/or natural language processing
• Experience working specifically on automated model evaluation

Benefits

• Remote work
• Medical, dental, vision, life, and disability insurance
• 401K retirement plan; flexible spending and health savings account
• 15 days of paid time off + additional front-loaded personal days
• 14 company-recognized holidays + paid volunteer days
• Up to 8 weeks of paid parental leave + 10 weeks of paid bonding leave
• LGBTQ+ Health Services
• Pet insurance