Test Engineering Manager

Summary

Join Harrison.ai, a well-funded global AI technology company, and lead the testing efforts for our regulated Software as a Medical Device (SaMD) products as a Test Engineering Manager. This key leadership role requires expertise in software quality and Agile environments. You will shape and scale testing capabilities, collaborate with cross-functional teams, and ensure software robustness. Lead and mentor a team of testers, driving adoption of modern testing tools and frameworks. The role involves defining and executing test strategies, integrating testing into the development process, and optimizing testing processes. Harrison.ai offers a flexible and remote-friendly work environment, a $1000 personal L&D budget, access to LinkedIn Learning, and market-leading parental support.

Requirements

• Strong experience leading technical test teams in Agile environments
• Expertise building, maintaining, and scaling test automation frameworks
• Proficient in scripting languages: Python, JavaScript/TypeScript, or similar
• Hands-on with automated testing for both front-end (UI) and back-end (API/microservices) layers
• Deep experience with performance testing tools such as k6, Locust, JMeter, or similar
• Solid understanding of modern CI/CD pipelines and how to integrate test automation
• Strong knowledge of software architecture, cloud platforms (AWS, Azure, GCP), containers (Docker), and distributed systems
• Experience working in or with regulated environments (ISO 13485, IEC 62304, or similar)

Responsibilities

• Define and execute test strategies that ensure product reliability, performance, and high code quality
• Champion test-driven development and quality engineering practices across the SDLC
• Lead and mentor a team of testers, fostering ownership, autonomy, and career development
• Drive adoption of modern tools and frameworks for automated, performance, and regression testing
• Collaborate with Product Owners, Developers, and UX Designers to refine requirements and acceptance criteria
• Ensure test scenarios are tightly integrated into the development process, enabling continuous delivery
• Represent QA in daily standups, sprint planning, and retrospectives, advocating for testability and automation
• Build and scale automation frameworks using tools such as Selenium, Cypress, Playwright, or similar
• Oversee integration of automated tests into CI pipelines (e.g., GitHub Actions, GitLab CI, Jenkins)
• Continuously improve test coverage, reducing time-to-release without sacrificing quality
• Design and execute performance, load, and stress tests to ensure product stability under real-world conditions
• Collaborate with infrastructure and DevOps teams to simulate traffic patterns and production-like environments
• Ensure thorough test coverage for edge cases, integrations, and failure modes
• Maintain defect tracking and reporting systems, triage issues efficiently, and drive root cause analysis
• Use metrics to measure product quality, test effectiveness, and release readiness
• Identify gaps in testing processes, tooling, and team capabilities—and lead continuous improvement efforts
• Stay current with emerging trends (e.g., AI/ML-assisted testing, shift-left testing, DevTestOps)
• Promote a culture of engineering excellence and quality awareness across teams

Preferred Qualifications

• Experience with infrastructure as code (Terraform, CloudFormation) to set up test environments
• Knowledge of security testing practices (OWASP Top 10, DAST/SAST tooling)
• Experience with AI/ML product testing (e.g., model validation, bias/fairness testing)
• Familiarity with observability tooling (Prometheus, Grafana) to monitor system health during tests
• Certifications like ISTQB Advanced Test Manager, AWS Certified DevOps Engineer, or equivalent

Benefits

• $1000 personal L&D budget
• Access to LinkedIn Learning
• Opportunities for internal mobility to fast-track your career
• Market-leading parental support including 16 weeks gender-neutral paid parental leave and $10,000 support for egg or sperm freezing
• Flexible and remote-friendly working