QA Manager

Summary

Join Caseware, a leading Fintech company, as a QA Manager to spearhead quality engineering across SaaS product teams. You will define and implement a scalable quality strategy, focusing on shifting testing left, reducing UI test reliance, and improving component and contract coverage. The role involves designing quality strategies for AI and analytics systems, optimizing CI/CD pipelines, and leading non-functional and production testing. You will also manage platform release management, build test data and observability systems, and define and measure quality KPIs. This exciting opportunity allows you to shape the future of quality in data- and AI-driven systems, working with cutting-edge technology and a collaborative team.

Requirements

• 7+ years' experience leading QA or quality engineering teams within modern SaaS or platform organizations in cloud-native environments (AWS)
• Expertise in building and scaling automated testing infrastructure, including integration with modern CI/CD pipelines (GitHub Workflows)
• Knowledge of testing strategies across the pyramid, from unit to E2E, including contract and performance testing (Cypress, Pact, K6)
• Solid front-end knowledge and testing fluency in HTML/CSS/JavaScript/TypeScript, and back-end knowlege in RESTFul APIs
• Experience applying AI tools in the testing lifecycle, such as for test generation, defect prediction, or intelligent automation, to improve coverage and efficiency
• Experience testing non-deterministic systems such as LLM applications, or statistical algorithms—along with familiarity with validation approaches for GenAI or agentic systems ( e.g.snapshot testing, LLM-as-a-judge, synthetic test case generation)
• Hands-on familiarity with observability tools (New Relic) and best practices for improving test signal and pipeline feedback loops
• Experience integrating QA tools like Zephyr Scale and on-prem CI/CD systems (GitHub)
• A strategic mindset paired with a pragmatic, systems-thinking approach to quality at scale

Responsibilities

• Set and Execute Quality Strategy Across the Platform
• Define and implement a scalable quality strategy for a growing SaaS platform—shifting testing left, reducing UI test reliance, and strengthening component and contract coverage
• Improve E2E test stability, data setup, and isolation to boost reliability and speed
• Enable fast, actionable feedback loops without slowing team velocity
• Design for Quality in AI & Analytics Systems
• Collaborate with data and AI teams to design quality strategies for non-deterministic systems like pipelines, statistical models, and GenAI features
• Apply advanced validation methods such as golden datasets, LLM-as-judge, behavioral testing, and synthetic test generation to support continuous delivery
• Improve CI/CD and Developer Workflows
• Optimize CI/CD pipelines for speed and reliability
• Define meaningful, maintainable quality gates that provide early warning without blocking delivery
• Champion tooling and practices that reduce flaky tests and noisy signals
• Lead Non-Functional and Production Testing
• Establish frameworks and processes for performance, scalability, and resilience testing across our services
• Enable testing-in-production approaches through canary releases, synthetic monitoring, and fault injection
• Manage Platform Release Management
• Oversee release management from a quality lens—ensuring readiness through test coverage, risk assessment, and coordination of validation activities across environments
• Build Test Data and Observability Systems
• Drive the creation of scalable, privacy & regulatory compliant test data management strategies
• Integrate logs, traces, and monitoring into automated test systems to improve diagnosis and root cause analysis of test failures
• Define and Measure Quality KPIs
• Track key DORA metrics such as test coverage, defect trends, test effectiveness and execution health, flakiness, and regression rates
• Use these insights to continually refine the quality strategy and guide investments in automation and infrastructure

Benefits

• Innovation is at our core. We work with cutting-edge technology in accounting and financial reporting, constantly pushing the boundaries to create impactful software solutions
• We are committed to a collaborative culture, where your ideas are valued, and knowledge sharing is encouraged within a supportive, inclusive team
• Work-life balance is important to us. We offer flexible work options, remote opportunities, and generous time-off policies to ensure a healthy work-life balance
• We offer competitive compensation, including a competitive salary and comprehensive benefits such as health insurance and retirement plans
• We are driven by impactful work . Your contributions directly affect how our clients manage financial processes and drive their success
• Recognition and rewards matter to us . We celebrate hard work through recognition programs, performance bonuses, and opportunities for career growth
• We embrace global opportunities . Work on international projects and collaborate with a diverse, global team