Senior GenAI Test Automation Engineer

Summary

Join Degreed's AI engineering team as a Senior SDET and take ownership of quality engineering for all GenAI-powered features and services. Collaborate with AI engineers, product managers, and data scientists to ensure AI and GenAI applications are accurate, robust, and responsible, paying close attention to challenges unique to LLMs. As a quality champion, you will play a key role in building the next generation of AI-driven learning experiences. This role requires extensive experience in automation testing, GenAI testing, and proficiency in various testing tools. You will design, develop, and maintain automated test suites, collaborate effectively within a team, and advocate for responsible AI testing standards. Degreed offers a comprehensive benefits package and a flexible work environment.

Requirements

• Minimum 6 years of automation testing experience for modern web, API, or backend services
• At least 1.5 years of hands-on testing experience with GenAI or LLM-based applications
• Strong skills in developing automated tests for UI, API, and end-to-end flows using Cypress and Typescript
• Hands-on experience with JMeter or BlazeMeter for performance and load testing
• Experience identifying and testing for hallucinations, bias, and data privacy risks in AI systems
• Proficient in integrating automated tests within CI/CD pipelines
• Strong analytical, problem-solving, and debugging abilities
• Effective communicator and collaborator in a cross-functional, embedded team environment
• Proactive, detail-oriented, and committed to responsible AI testing practices

Responsibilities

• Design, develop, and maintain automated test suites for GenAI and AI-driven features (regression, integration, end-to-end, and performance)
• Own the quality and reliability of AI products by rigorously testing for hallucinations, privacy risks, and bias
• Collaborate closely with AI engineers, product managers, and data scientists throughout the feature lifecycle
• Utilize Cypress, JMeter/BlazeMeter to validate both functional and performance aspects of GenAI systems
• Integrate quality processes and best practices into the AI team’s workflows
• Contribute to release readiness and provide actionable quality metrics to stakeholders
• Advocate for responsible and ethical AI testing standards within the team
• Stay current with the latest techniques and tools in GenAI testing and automation
• Foster a culture of continuous improvement and trust in AI-powered experiences

Benefits

• We take care of our people with a comprehensive benefits package designed to support your well-being, growth, and success
• View the full details here: https://px.sequoia.com/globalcompanybenefits
• Degreed offers flexible work arrangements tailored to each role
• Some positions are fully remote, while others follow a hybrid model for employees near an office