Senior Quality Engineer, AI

Summary

Join Descript, a leading AI-powered audio and video editing tool company, as a QA professional. You will collaborate with the AI team to develop test plans, establish quality standards, and build scalable evaluation processes for AI models. Responsibilities include identifying areas for improvement, creating benchmarks, and documenting findings. You will also work with third-party providers and mentor other team members. This role requires a Bachelor's degree, 5+ years of QA experience, and 2+ years leading AI model evaluation. Descript offers a competitive salary, generous healthcare, catered lunches, and flexible vacation time.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience
• 5+ years QA experience
• 2+ years experience leading evaluation of AI models
• 2+ years experience as a test lead on a team, product area, or feature
• Experience working with AI research teams
• Ability to collaborate effectively with cross-functional teams and stakeholders

Responsibilities

• Work hand-in-hand with our brilliant AI team to create test plans, run experiments, and identify areas for improvement or inconsistencies in model behavior
• Set the gold standard for model quality by creating baselines, benchmarks, and rating systems
• Build scalable processes for evaluating AI models—both quantitatively and qualitatively—so we can stay ahead of the game
• Keep everything organized with clear test plans, documentation, and bug reports that your future self (and team) will thank you for
• Tap into internal and external resources to gather the data we need to refine and perfect our models
• Be the go-to expert for working with third-party service providers to ensure they meet our sky-high quality standards
• Continuously improve testing tools and methodologies
• Share the QA love by mentoring others and collaborating across teams to make sure everything works beautifully together

Preferred Qualifications

• Experience evaluating AI speech or video models
• Experience writing SQL queries
• Experience using Python for scripting

Benefits

• Generous healthcare package
• Catered lunches
• Flexible vacation time