Skip to main content
#1 on AndroidWorld

> agent-qa

The self-improving QA agent for your software factory.

Give your coding agents a QA agent that learns your app. Run natural-language tests across web and mobile, build memory with every run, and catch regressions before you ship.

Trusted by teams at scale

Your product evolves with every release. Your QA learns with every run.

A self-improving test harness with persistent memory and frontier browser and mobile control.

Benchmarked to perform.

#1

AndroidWorld

> agent-qa

Overall
100% 116/116
Easy
100% 61/61
Medium
100% 36/36
Hard
100% 19/19

#1

AppControlBench

> agent-qa

Overall
99.6% 114.5/115
iOS
100% 60/60
Android
99.1% 54.5/55

#1

100% task success · pass@1

116 / 116 tasks completed

Read the results

99.6%

Overall completion

100% iOS · 99.1% Android

Read the results

Agentic Testing

Write tests in plain language. agent-qa runs them, adapts when your UI changes, and verifies the same expected outcome.

Explore agentic testing

Memory engine

We built memidex, an opinionated memory engine that learns how your product works and brings that context to the next run.

Self-improving

agent-qa learns from every run, remembers what works, and forgets what’s out of date.

10K+ Regressions caught

Built for Agents

The verification layer for your agentic factory. Give your agents the tools to test changes and act on the evidence.

Durable

Tests, memory, and learned improvements live in files you can version, share, and reuse across runs.

Frontier Browser & Mobile Control capabilities

Give your agents frontier browser and mobile control to navigate apps, complete tasks, and verify results.

Sandboxed

All hook executions are sandboxed. Run your own code for setup, checks, and cleanup.

Caching

Intelligent caching saves up to 60% of tokens and makes repeat runs up to 5× faster.

Multi-platform

One testing platform for web and mobile.

Time is money tokens.

2,600 Manual testing hours saved

Explore live demos.

Switch between real agent-qa runs and inspect the evidence directly.

agent-qa Supabase Run
Demo for illustration only. All product names and logos are property of their respective owners.

Questions, answered.

Can my coding agent set up and run agent-qa?

Yes. Give it the complete setup prompt and it can initialize a workspace without menus, configure an authorized model, write a meaningful test, run it through CLI or local MCP, and inspect the evidence. Your agent may need your help with a model credential or subscription sign-in. The same tests and results remain available to humans in the repository and local dashboard.

Set up with your agent

Does agent-qa generate test code or scripts?

No. There is no generated script and no selector file. Every run reads the live screen and works out what to do from there, which sounds like repeating yourself and is not: no run is wasted, because each one feeds what it learned back in and the agent gets more accurate about your product over time. A validated action plan is cached and replayed while the screen still matches, which can reduce planning work on repeat runs, and the moment the interface changes under it the stale plan is purged and that step is worked out again. Measure the runtime and token savings on your own suite, and none of that speed comes from freezing it into a recording.

How caching works

What does it remember between runs?

What it learned about your product, written to disk as markdown under a memory root in your repository and organised by product, suite and test. It is not hidden model state. You read it in a pull request like any other file, and a new observation has to hold up against past runs before a planner is allowed to use it.

How memory works

Does the same test work on web and mobile?

Yes, which is the point of describing behaviour instead of selectors. You name the control the way you would say it out loud, the Checkout button or the issues table, and agent-qa resolves it against whatever is in front of it. Web runs use browser runtimes it installs and manages, leaving the browsers you already have alone. Android and iOS run through Appium drivers and the usual platform tooling, against an emulator, a simulator or a device on your desk.

Mobile testing guide

Which models can I use?

Any OpenAI-compatible or Anthropic-compatible endpoint, Gemini, or a local model served through something like Ollama or LM Studio. Codex and Claude Code subscriptions work too, through the optional subscription auth package. Pick a multimodal one: runs read screenshots, so text-only models are a poor fit for visual QA.

Connect a model

Is agent-qa free?

Yes. It is free to install and free to run, the source is public, and no feature is held back behind a paid tier. The tests you write and the memory it builds are ordinary files in your own repository. There is no license fee for FSL-permitted use. You supply the execution infrastructure and pay any model inference costs, which the cache can help reduce.

Read the license

Give your coding agent a QA agent.

Page view