Staff QA Engineer

Callstack
Summary
Join Callstack, a top cross-platform consultancy and development company specializing in React.js and React Native, and work with the best React Native experts on applications used by millions worldwide. As a Staff QA Engineer (with AI), you will re-imagine the QA stack with AI, introducing LLM-powered test-case generation and other AI-powered testing solutions. You will define company-wide best practices for AI-assisted testing and own the QA architecture across various platforms. You will also embed quality gates into CI/CD, build evaluation frameworks for LLM features, and collaborate with other teams to instill a "shift-left" quality culture. You will lead internal QA guilds and workshops, contribute to open source projects, and speak at meetups and conferences. This role offers opportunities for professional growth and development within a supportive and innovative environment.
Requirements
- A QA engineer with 10+ years in automated testing (web, mobile, or API) and 2+ years integrating AI/ML into testing workflows
- Bachelor's Degree, Master's Degree or Ph. D in Computer Science, Data Science, Artificial Intelligence, or a related field
- Experienced DevOps optimizing and scripting pipelines and workflows for other engineers
- Fluent in a modern programming language used for tests (Python, TypeScript)
- Hands-on with AI-focused testing tools (Prompt-based test generation or custom GPT-powered scripts)
- Experienced in CI/CD, containerization, and cloud services
- Passionate about quality for AI systems - you know how to measure hallucinations, bias, latency, and model drift
- A clear communicator in English (B2+), able to explain why that edge-case matters to both engineers and execs
- Proactive, analytical, and endlessly curious, always chasing the next flaky test until it’s gone
- Fun to work with :)
Responsibilities
- Re-imagine the QA stack with AI, introduce LLM-powered test-case generation, self-healing test suites, autonomous root-cause analysis, and visual-regression diffing driven by computer vision
- Define company-wide best practices for AI-assisted testing, covering unit, integration, E2E, performance, security, and bias/ethical checks for ML models
- Own the QA architecture across web, mobile, API, and ML pipelines - selecting the right mix of open-source tools (e.g., Playwright, Appium, GPTDriver, Maestro)
- Embed quality gates into CI/CD (GitHub Actions, GitLab CI, Jenkins, or Azure Workflows)
- Build evaluation frameworks for LLM features (response accuracy, toxicity, hallucination rate, guard-rail coverage) and automate regression baselines
- Collaborate closely with Developers, DevOps, and Product Owners to instill a “shift-left” quality culture from design through production
- Lead internal QA guilds & workshops, sharing new AI testing patterns, code snippets, and lessons learned
- Contribute to open source - submit PRs, maintain plugins, and publish tools that push the testing community forward
- Speak at meetups & conferences to evangelize AI-first QA practices
Benefits
- 24 paid days off & 30 days paid sick leave for B2B contractors
- Fully-covered life insurance
- Private healthcare for you and your family
- Free access to mental health platform - Helping Hand
- Multisport Card or monthly allowance for other sports activities
- Individual Wellbeing & Development Budget
- Monthly lunch allowance
- Accounting costs refund for B2B contractors
- Flexible working hours and fully remote work possibility
- Cool office in Wrocław city center
- Magnificent team events and activities
- Company-wide workation and team building workshops
- Top-notch hardware - Apple devices
- Possibility to participate in React Universe Conf
Share this job:
Similar Remote Jobs
