vostride/agent-qa 预览 preview

vostride/agent-qa

Open-source self-improving QA agent for software teams. A test harness with memory. Write tests in natural language for web and mobile. agent-qa learns from every run, adapts to UI changes, and catches regressions before you ship.

项目介绍Project Overview

agent-qa 是面向 Web 与移动端的自进化智能体测试框架,使用自然语言编写测试。用例执行具备自愈能力,UI 变更时自动重新观察并重试路径。每一轮运行会从产品、套件和用例观测中沉淀执行记忆,并随时间改进后续测试。同时提供仪表板、CLI 和 MCP 接入。适用于在快速迭代的 Web 与移动项目中编写可维护的端到端测试。需提前安装 Docker 以运行沙箱钩子。

agent-qa is an agentic QA harness for web and mobile that lets users write tests in natural language. It features self-healing execution that re-observes the UI and retries failed actions within the same run, plus an execution memory that improves future runs from past observations, including healed steps. Tests, configs, hooks, and memory live in version-controlled code, with a dashboard, CLI, and MCP for coding agents. Use it for end-to-end testing on rapidly evolving web and mobile projects. Docker must be installed beforehand to run sandboxed hooks.

或使用命令行安装(适合开发者)Or use CLI install (for developers)

命令行安装CLI Install

dsh plugin --profile web add github:vostride/agent-qa

vostride/agent-qa 加入你的 DSH 配置(web profile)即可启用。

READMEREADME

agent-qa banner

npm npm version GitHub stars

Docs · Demo · Issues

agent-qa

The self-improving Agentic QA harness with Memory

Write tests in natural language for web and mobile. agent-qa learns from past runs, adapts to UI changes, and catches regressions before you ship.

Docs | Quickstart

Features

  • Write tests in natural language for web and mobile: Define actions and assertions in human language while agents work from visible roles, labels, and screen state.
  • Self-healing test execution: When any sub-action, such as click, fill, or select, fails, agent-qa re-observes the UI and tries a different path in the same run. Tests recover from UI drift and flaky interactions instead of failing on the first broken action.
  • Self-improves with Memory: With every test run, agent-qa builds execution memory from product, suite, and test observations, then adds that context to future runs. agent-qa also curates memory from steps that were healed during execution, helping future runs avoid the same mistake.
  • Built for humans and machines: A polished dashboard and CLI for developers, plus MCP and skills for coding agents.
  • Accelerate runs with smart Cache: The action cache reuses validated plans across similar subsequent test runs, reducing planner work, token usage, and runtime overhead.
  • Run sandboxed hooks during tests: Run Node, Bun, Python, or Bash hooks in isolated Docker containers to set up environments, call APIs, seed fixtures, tear down state, or pass structured outputs back into the active test run.
  • Open source, reviewable QA: The harness is open source, and tests, configs, hooks, memory, and suite logic all live as version-controlled code, so every change can be diffed, reviewed, reused, and shared across teams.
  • Bring your own LLM: Run tests with the model of your choice via OpenAI- and Anthropic-compatible endpoints, Gemini, local or open-source models, and subscriptions like Codex and Claude Code.

Quickstart

Install the package:

npm install -D agent-qa

For Codex or Claude Code subscription auth, also install:

npm install -D @vostride/agent-qa-subscription-auth

Install Docker before using hooks. agent-qa runs hooks in a sandboxed runtime, and Docker is required for the Node, Bun, Python, and Bash hook containers.

Initialize agent-qa and install the runtime support you need:

npx agent-qa init
npx agent-qa install-browsers --chromium
# Mobile projects:
npx agent-qa install-mobile-drivers --all

Start the dashboard, complete auth, and run tests from the UI:

npx agent-qa dashboard --open

For the full setup flow, use the quickstart.

CLI

Run tests from the CLI:

npx agent-qa run tests/hacker-news-top-story.yaml

Docs

上一个 Prev dsh-im 下一个 Next dsh-vision-toolkit