Associate Manager, Data Annotation

Summary

Join Qualtrics as an Associate Manager, AI Data Annotation and lead a team responsible for building and maintaining high-quality datasets for machine learning models. You will collaborate with various teams, manage annotation workflows, and ensure timely project completion. This role requires strong leadership, technical understanding, and experience in data annotation and management. Qualtrics offers a hybrid work model, various benefits, and opportunities for professional development. The successful candidate will be a key contributor to the company's AI initiatives, shaping the culture and setting the vision for the Language Engineering team. This is a chance to work in a fast-paced, collaborative environment with a team dedicated to innovation and customer success.

Requirements

• BA/BS or above in linguistics, or another relevant field
• 5+ years of professional experience
• 2+ years managing data annotation or related projects
• 2+ years of people management or team lead experience
• Strong understanding of data annotation and evaluation workflows for ML use cases
• Ability to quickly grasp technical concepts and learn custom built tools
• Excellent organizational, written, and verbal communication skills
• Ability to deliver high quality results under tight deadlines
• Comfortable working in a fast paced, collaborative work environment
• Team player with exceptional interpersonal skills and a solution-oriented attitude
• Strong analytical, problem-solving, and critical-thinking skills
• Independent, proactive, and self-motivated

Responsibilities

• Work as part of a multidisciplinary team to research/define requirements and develop processes for curating new datasets, data labeling,ƒdata and transcription pipelines
• Lead a multi-lingual team of linguists, language experts, and transcriptionists that are building various knowledge and data assets for Qualtrics by defining new data annotation tasks, writing annotation guidelines, and developing audit metrics
• Define and promote best practices for new data labeling efforts in accordance with product needs, including measuring and ensuring annotation quality
• Build a pragmatic understanding of the life cycle of machine learning systems and behaviors
• Contribute to process improvements to improve efficiency and quality of portfolio of predictive models by facilitating collaborations with scientists to build, test, and debug machine learning models
• Manage various annotation workflows for language experts (internal and external), ensuring timely completion of multiple concurrent projects
• Oversee your team as they work closely with, incorporate feedback from, and audit work of data labeling specialists and external vendors
• Be able to deal with ambiguity, multi-task, and adapt to changing priorities in a fast paced, highly collaborative, dynamic work environment
• Work with operational teams to investigate and resolve bugs related to models and data issues
• Advise and coach team members to develop their skills and work towards their career goals
• Set the standard for your team for collaborating with peers, prioritizing features, and working with a sense of urgency to deliver value to customers
• Set the vision and expectations for the Language Engineering (LE) team
• Design objectives and key results to help the LE team scale its efforts to support more ML projects
• Help define processes to improve speed to delivery of the various annotation projects
• Focus on your career development by taking advantage of Qualtrics’ weekly allotted time to take courses on LinkedIn and other similar platforms
• Collaborate across teams to ensure continuity of projects and drive consensus

Benefits

• Wellness Reimbursement for $300 per quarter for wellness activities including gym memberships, spa massages, workout equipment, meditation apps, and much more
• $1800 Experience bonus to be used for an “Experience” of your choosing
• QMentorship Program matches you with a mentor inside Qualtrics to get meaningful coaching from someone outside your team
• Amazing QGroup Communities; MOSAIQ, Green Team, Qualtrics Pride, Q&Able, Qualtrics Salute, and Women’s Leadership Development, which exist as places for support, allyship, and advocacy
• The Qualtrics Hybrid Work Model: Our hybrid work model is elegantly simple: we all gather in the office three days a week; Mondays and Thursdays, plus one day selected by your organizational leader. These purposeful in-person days in thoughtfully designed offices help us do our best work and harness the power of collaboration and innovation. For the rest of the week, work where you want, owning the integration of work and life