Associate Manager, Data Annotation

Summary

Join our team at Qualtrics as we create software for delivering exceptional frontline experiences and building high-performing teams. We're looking for a talented AI Data Annotation and Transcription Manager to lead our annotation team, working with product managers, engineers, and scientists to plan and scope projects, oversee the entire annotation process, and continuously evaluate opportunities and challenges in the ever-changing AI landscape.

Responsibilities

• Work as part of a multidisciplinary team to research/define requirements and develop processes for curating new datasets, data labeling,ƒdata and transcription pipelines
• Lead a multi-lingual team of linguists, language experts, and transcriptionists that are building various knowledge and data assets for Qualtrics by defining new data annotation tasks, writing annotation guidelines, and developing audit metrics
• Define and promote best practices for new data labeling efforts in accordance with product needs, including measuring and ensuring annotation quality
• Build a pragmatic understanding of the life cycle of machine learning systems and behaviors
• Contribute to process improvements to improve efficiency and quality of portfolio of predictive models by facilitating collaborations with scientists to build, test, and debug machine learning models
• Manage various annotation workflows for language experts (internal and external), ensuring timely completion of multiple concurrent projects
• Oversee your team as they work closely with, incorporate feedback from, and audit work of data labeling specialists and external vendors
• Be able to deal with ambiguity, multi-task, and adapt to changing priorities in a fast paced, highly collaborative, dynamic work environment
• Work with operational teams to investigate and resolve bugs related to models and data issues
• Advise and coach team members to develop their skills and work towards their career goals
• Set the standard for your team for collaborating with peers, prioritizing features, and working with a sense of urgency to deliver value to customers