Playwright E2E MCP

io.github.trajectiq-aiv0.1.0更新于 Oct 5, 2026

Run and debug Playwright E2E tests: failure analysis, DOM inspection, visual diffs, flaky diagnosis.

已验证STDIO仅桌面Developer ToolsBrowser Automation

概览

AI 生成的概览

让助手运行、调试和检查 Playwright 端到端测试,提供结构化失败诊断、实时 DOM 检查和视觉差异对比。

功能
围绕 Playwright 提供八个工具:run-test 运行测试并返回通过/失败统计、分类后的失败原因和修复提示;get-failure 深入分析单个失败,给出堆栈、期望值与实际值、来自 trace 的失败时 DOM 快照、失败的网络请求和控制台错误;list-tests 列出测试用例。此外还能以无头方式检查实时页面、校验 CSS 选择器、依据真实选择器生成测试、与基线对比视觉状态,并把失败的测试重复运行 2 到 10 次以判断是偶发还是稳定失败。
适用场景
适用于项目已有 Playwright 端到端测试,并希望助手运行测试、解释失败原因、修复失效选择器、发现视觉回归,或判断某个失败是否为偶发。若没有 Playwright 测试套件或只做单元测试,则意义不大。
运行要求
以本地进程方式运行,可通过 npx 或本地检出启动。需要 Node.js 20 或更高版本、安装了 @playwright/test 的项目,以及 Playwright 浏览器(例如 npx playwright install chromium)。可选环境变量 PW_MCP_PROJECT_ROOT、LOG_LEVEL、LOG_FORMAT。涉及访问应用的测试还需要运行中的开发服务器。
安装前请注意
工具会写入项目:generate-e2e-test 默认写入测试文件并可覆盖已有文件,compare-visual-state 会在 .pw-mcp/visual/ 下保存基线。run-test 会执行项目的 Playwright 测试,可能启动浏览器并访问 URL,包括外部地址。路径被限制在项目根目录内且会检查命令行参数,但仍应留意助手实际执行的操作。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Playwright E2E MCP,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。

其他 MCP 客户端

参照 仓库 中的启动说明。

README

playwright-e2e-mcp

[CI] [release] [MCP Registry]

An MCP server that lets AI agents run, debug, and inspect Playwright end-to-end tests — with structured results, actionable failure diagnostics, and live DOM inspection.

run-test ──▶ get-failure ──▶ inspect-page ──▶ validate-selector ──▶ fix ──▶ re-run   ▲                                                                    │   └──────────────────────── list-tests ◀────────────────────────────────┘

Instead of handing an agent raw Playwright output, this server turns every run into machinable results: pass/fail stats, per-failure messages with file:line, a failure kind (assertion, timeout, browser crash, syntax error, dead dev server, full disk…), and a concrete "how to fix" hint. When a test fails because a selector no longer matches, the agent can open the live page in a headless browser, see the real DOM with unique CSS selectors, and validate the replacement selector before re-running.


Tools

ToolPurpose
run-testRun Playwright tests and return stats, failures, diagnostics and hints
get-failureDeep analysis of one failure: stack, expected/actual, DOM snapshot at failure (from the Playwright trace), next steps
inspect-pageOpen a URL headlessly and return the rendered DOM: selectors, visibility, boxes, text, console output, HTML
list-testsList available tests (file, line, full title, projects) with filtering
validate-selectorCheck a CSS selector against a live page: validity, match count, sample matches
generate-e2e-testScaffold a Playwright test from a description using the project's real selectors, discovered from recent file changes
compare-visual-stateVisual regression: screenshot before/after a change and report what moved and how colors shifted
diagnose-flakyRun a failing test 2–10 times with retries disabled and return an evidence verdict: CONSISTENTLY FAILING, FLAKY or NOT REPRODUCING

run-test

ArgumentTypeDescription
projectRootstringProject directory (default: server working directory)
testFilesstring[]Files/directories relative to the root; file:line supported. Omit to run everything
grepstringOnly run tests whose title matches this regex
browserchromium | firefox | webkitPlaywright project to run (matched against config project names)
headedbooleanVisible browser window
timeoutMsnumberHard wall-clock limit for the run (default 120000); the whole process tree is killed past it and partial results are returned
testTimeoutMsnumberPer-test timeout passed to Playwright
workers / retriesnumberPassed through to Playwright
configstringplaywright.config path or 1-based index when the project has several
retryOnFailurebooleanAuto-retry failures once before reporting them (default true; ignored when retries is set)
lastFailedbooleanOnly re-run tests that failed in the previous run (Playwright --last-failed) — the fast fix → re-run loop
argsstring[]Extra CLI flags (shell metacharacters are rejected)

Flakiness handling: by default the server injects --retries=1 (unless the config already sets retries), so a test that passes on the retry is reported as flaky, not failed. Traces are captured automatically (--trace=retain-on-failure) so get-failure can show the DOM at the moment of failure.

Example result:

markdown
## Playwright run — ❌ FAILED
**Command:** `playwright test --config playwright.config.ts tests/checkout.spec.ts --reporter=json`**duration 4.2s · exit 1 · config `playwright.config.ts`**
| passed | failed | flaky | skipped | duration || ---: | ---: | ---: | ---: | ---: || 0 | 1 | 0 | 0 | 1.1s |
### ❌ 1 failing test(s)
### 1 of 1. checkout.spec.ts › pays with card**File:** `checkout.spec.ts:5`  |  **failed · server-unreachable**
### ⚠️ SERVER_NOT_RUNNINGYour app (dev server) does not appear to be reachable. Start it in another terminal(e.g. npm run dev / npm start), keep it running, then retry — or configure `webServer`in playwright.config.* so Playwright starts it automatically.

get-failure

ArgumentTypeDescription
indexnumber1-based failure index from the last run (default 1)
projectRootstringOnly used when re-reading the stored report

Returns the message/code frame, expected vs actual, stack, failure kind with a diagnosis, the test's console output, the DOM snapshot from the Playwright trace (plus the failed action, its selector, and the action log leading up to it), the network requests that failed (4xx/5xx, dead endpoints, no-response — with method, URL, status and resource type), the console errors/warnings the page logged before the failure, and numbered next steps (re-run this single test by file:line, headed/debug mode, validate-selector when the message mentions a locator, …).

inspect-page

ArgumentTypeDescription
urlstringFull http(s) URL to open (required)
projectRootstringProject whose Playwright launches the browser
selectorstringInspect matches of this CSS selector instead of the whole DOM
waitForstringWait for a selector (CSS or text=…) before inspecting
waitUntilload | domcontentloaded | networkidleNavigation wait condition
includeHtmlbooleanInclude the rendered HTML (capped)
maxHtmlCharsnumberHTML cap, default 20000
timeoutMsnumberOverall limit, default 45000

Returns each element's unique CSS selector, tag, visibility, bounding box, text and attributes, plus captured console messages (errors first).

list-tests

ArgumentTypeDescription
projectRootstringProject directory
configstringConfig path or 1-based index
testDirstringRestrict scanning to a directory (must stay inside the project)
filterstringCase-insensitive substring filter on file › title
limitnumberMax tests returned, default 500

Uses playwright test --list when Playwright works, and falls back to a source scan (keeping the reason) when the install or a spec file is broken.

validate-selector

ArgumentTypeDescription
urlstringLive page to test against (required)
selectorstringCSS selector to validate (required)
projectRootstringProject whose Playwright launches the browser
timeoutMsnumberOverall limit, default 45000

Verdicts: ✅ VALID — N matches (with a sample of matches), ✅ VALID — 0 matches (with debugging advice), ❌ INVALID (parse error + fix), or a warning when the input uses a Playwright-only engine (text=, xpath=, >>, :has-text()), which is not plain CSS.

generate-e2e-test

ArgumentTypeDescription
descriptionstringWhat the test should cover (required)
pageUrlstringPage the test starts on (default: baseURL / webServer.url from config)
testDir / filestringWhere to write the spec (default: detected testDir + generated/<slug>.spec.ts)
writebooleanWrite the file to disk (default true)
overwritebooleanReplace an existing file at the target path
liveInspectbooleanCross-check selectors against the live page (default on when a URL is known)
projectRoot / configstringAs with the other tools

Reads the agent's recent changes (git status, falling back to git diff HEAD~1, then recent mtimes), extracts the locators those files actually declare (data-testid, getByRole, aria-label, placeholder, id, name, element text), ranks verified-live selectors first, writes a spec built from them, and reports each selector with its source file:line.

compare-visual-state

ArgumentTypeDescription
urlstringPage to capture (required)
namestringBaseline id, e.g. checkout-page (letters, digits, . _ -)
actioncompare | baselinecompare (default) diffs; baseline re-captures the reference
selectorstringCapture just this element
fullPagebooleanCapture the full scrollable page
tolerancenumberPercent of pixels that may differ (default 0.1)
pixelThresholdnumberPer-pixel channel delta considered different (default 60)
waitUntil / waitFor / timeoutMs—As with inspect-page

The first call saves a baseline under .pw-mcp/visual/ (add that to .gitignore, or commit it for CI comparisons). Later calls report changed-pixel counts, merged regions ((x, y) 120×40 — 1,200 px), the average color shift ("blue → red"), and write a red-highlighted diff image for review.

diagnose-flaky

ArgumentTypeDescription
testFilesstring[]Tests to diagnose (file:line supported). Defaults to the tests that failed in the most recent run
runsnumberTimes to run them, 2–10 (default 3)
browser / headed / workers / config—As with run-test
timeoutMsnumberHard wall-clock limit per run (default 120000)
projectRootstringProject directory

Every run executes with --retries=0 and auto-retry disabled, so each result is honest evidence. The response contains a per-run table (status, duration, first failure), the count of distinct normalized error signatures, and one of:

  • ❌ CONSISTENTLY FAILING — failed every run (same error → reproducible bug, different errors → still broken, just noisy). Fix it; it is not flaky.
  • ⚠️ FLAKY — some runs passed. Includes N of M counts and whether the failures share one signature (real intermittent bug) or vary (timing/environment instability).
  • ✅ NOT REPRODUCING — passed every re-run; the original failure was one-off.

The last run is stored, so get-failure can analyze it immediately afterwards.


Installation

Requirements:

  • Node.js ≥ 20 (the server is built on MCP SDK v2 — the 2026-07-28 spec line)
  • A project with @playwright/test installed and browsers available (npx playwright install chromium)

No npm account needed — install straight from GitHub (the prepare script builds dist/ automatically on install):

bash
npx -y github:trajectiq-ai/E2Enpm install -D github:trajectiq-ai/E2E @playwright/test   # or as a project dependencynpx playwright install chromium

Or grab the packaged tarball from the repo's GitHub Releases page and install it locally:

bash
npm install -D https://github.com/trajectiq-ai/E2E/releases/download/v0.1.0/playwright-e2e-mcp-0.1.0.tgz

Listed in the official MCP Registry as io.github.trajectiq-ai/E2E — registry-aware clients discover it there, and every v* release tag republishes the entry from CI via server.json.

MCP client configuration

Claude Code / generic (project-scoped):

json
{  "mcpServers": {    "playwright-e2e": {      "command": "npx",      "args": ["-y", "github:trajectiq-ai/E2E"],      "env": { "PW_MCP_PROJECT_ROOT": "/absolute/path/to/your/project" }    }  }}

Claude Desktop / Cursor / Windsurf: add the same block to their MCP config file. The server uses its working directory as the project root; set PW_MCP_PROJECT_ROOT when the client launches it somewhere else (e.g. your home directory).

Codex / VS Code / Copilot CLIs:

bash
codex mcp add playwright-e2e -- npx -y github:trajectiq-ai/E2Ecode --add-mcp '{"name":"playwright-e2e","command":"npx","args":["-y","github:trajectiq-ai/E2E"]}'

Claude Desktop (one-click): download and double-click the .mcpb Desktop Extension attached to the latest release — the bundle ships its own dependencies, so no Node setup is required.

Claude Code:

bash
claude mcp add playwright-e2e -- npx -y github:trajectiq-ai/E2E

Gemini CLI / Qwen Code: paste the mcpServers block above into .gemini/settings.json (Qwen Code: .qwen/settings.json) — both speak the same MCP settings format.

All tools ship MCP tool annotations (readOnlyHint, destructiveHint, idempotentHint, openWorldHint), so clients can show accurate safety prompts before running anything.

From a local checkout:

json
{  "mcpServers": {    "playwright-e2e": {      "command": "node",      "args": ["/path/to/playwright-e2e-mcp/dist/index.js"],      "env": { "PW_MCP_PROJECT_ROOT": "/path/to/your/project" }    }  }}

Configuration

Environment variableDefaultPurpose
PW_MCP_PROJECT_ROOTserver cwdDefault project root for every tool
LOG_LEVELinfodebug | info | warn | error | silent
LOG_FORMATtexttext or json (structured)

Logs always go to stderr — stdout is reserved for the MCP protocol.

Typical workflow

  1. generate-e2e-test { "description": "checkout with a saved card" } — scaffolds a spec from your real selectors (skipped if you write the test yourself).
  2. list-tests — see what exists (tests/checkout.spec.ts:5 checkout › pays with card).
  3. run-test { "testFiles": ["tests/checkout.spec.ts"] } — run it; get stats + failures (flaky tests are auto-retried once before being called failures).
  4. get-failure { "index": 1 } — read the code frame, expected/actual, the DOM snapshot at failure from the trace, the failed network requests, the page's console errors, and next steps.
  5. If it looks selector-related: inspect-page { "url": "http://localhost:3000/checkout" } to see the real DOM, then validate-selector to prove the replacement selector works.
  6. After changing CSS/components: compare-visual-state { "url": "…", "name": "checkout" } to catch unintended visual regressions.
  7. If a failure looks intermittent: diagnose-flaky { "runs": 3 } — get the evidence verdict (flaky vs consistently broken) before deciding what to fix.
  8. Fix the spec or the app, then re-run only what failed: run-test { "lastFailed": true }, and repeat until green.

Edge cases handled

SituationBehaviour
No Playwright installedNO_PLAYWRIGHT error with the exact install commands for your package manager
Dev server not runningFailure classified server-unreachable / SERVER_NOT_RUNNING with a "start your dev server" hint (and webServer advice)
Test exceeds timeoutMsProcess group is killed (SIGINT→SIGKILL on POSIX, taskkill /T /F on Windows) and partial results are returned
Browser crashesClassified browser-crash with retry / reinstall guidance
Windows backslashesAll paths normalized lexically (C:\a\..\b → C:/b); unit-tested on both platforms
Flaky testsFailing tests are automatically retried once (--retries=1) before being reported; passes surface as flaky with a stability warning; diagnose-flaky decides flaky-vs-broken with multi-run evidence
Trace/DOM context--trace=retain-on-failure is passed automatically, so get-failure can show the exact DOM at the moment of failure — plus the failed network requests (*.network logs) and console errors from the same trace
Slow re-runs after a fixrun-test with lastFailed: true re-runs only the tests that failed last time (--last-failed)
Several playwright.config filesReturns a numbered menu (MULTIPLE_CONFIGS); pick with config: "2" or a path
Syntax error in a specSYNTAX_ERROR with file:line; nothing crashes; list-tests falls back to a source scan
MCP client disconnectsPer-request AbortSignal kills the run; stdin end triggers shutdown, and every tracked child tree is force-killed (killActiveChildren)
Disk fullENOSPC detected → DISK_FULL with a "free space" hint; logging never throws
Malicious paths../../etc/passwd, absolute paths outside the root, URLs and null bytes are rejected with INVALID_PATH; CLI args are shell-metacharacter-checked

Security notes

  • No shell: Playwright is spawned as node <playwright/cli.js> … with an argument array — no command interpolation.
  • Path sandbox: user paths are resolved lexically and must stay inside the project root.
  • Cleanup: temp report/script files are written to the OS temp dir and removed; child processes are tracked and killed on shutdown.

Development

src/├── index.ts            # bin entry point (--version/--help, main-module guard)├── server.ts           # McpServer setup, tool registration, shutdown handling├── tools/              # the eight tools + shared plumbing├── utils/              # playwright-runner, report-parser, project-detector, path-utils,│                       # logger, trace-reader (trace.zip → DOM/network/console),│                       # image-diff (PNG codec + pixel diff), change-analyzer└── types/              # shared interfaces and the ErrorKind taxonomy

Built on @modelcontextprotocol/server v2 (the 2026-07-28 MCP spec line) with Zod v4 standard schemas; every tool declares spec tool annotations.

bash
npm installnpm run build   # tsc → dist/ (zero errors)npm test        # build + test/run-tests.mjs (70 unit tests, any Node ≥20)npm run e2e     # build + e2e/run.mjs: live MCP ↔ Playwright integration suite

Tests cover the report parser (sample Playwright JSON, trace attachments), path utils (Windows and macOS paths, sandboxing), the project detector (temp-dir fixtures: config discovery, multiple configs, missing install, test-file scanning), the shared tool helpers, the trace reader (synthetic trace.zip: error, failed action, DOM snapshot, *.network failed-request parsing, console error/warning events), the image diff (PNG round-trip, regions, color shift, dimension changes), the change analyzer (selector extraction, git + mtime paths) and the flaky verdict logic (failure signatures, CONSISTENTLY FAILING / FLAKY / NOT REPRODUCING / NO TESTS RAN).

Integration suite (npm run e2e)

Unit tests prove the logic; the integration suite proves the loop. It boots the real server over stdio against a live fixture app and a Playwright project under e2e/fixture/, then drives it exactly like an MCP client and asserts ~40 behaviours that only appear end-to-end:

  • initialize handshake, 8 tools, spec tool annotations and object input schemas,
  • live DOM inspection, CSS selector validation (matches, zero matches, engine syntax, parse errors), dead-server detection,
  • visual regression: baseline → unchanged compare → blue → red diff detection,
  • run-test pass/fail/lastFailed stats and meta lines,
  • get-failure trace diagnostics: DOM at failure, the 404 network request, the console.error message, diagnosis and next steps,
  • auto-retry turning a first-run failure into PASSED (1 flaky),
  • diagnose-flaky verdict FLAKY (2 of 3 runs) with retries disabled,
  • generate-e2e-test writing its scaffold, plus error paths (missing test path, unknown tool, unreachable server).

First run needs the browser once: npx playwright install chromium. CI runs the suite on Ubuntu and Windows (see .github/workflows/ci.yml).

Try the example

With Playwright installed in your project:

bash
npx playwright test examples/sample-test.spec.ts

or ask your agent to call run-test with "testFiles": ["examples/sample-test.spec.ts"] — it hits the public example.com page, so it verifies browsers, network and the MCP pipeline in one shot.

License

MIT

来源:README.md,提交 7b3a543

工具

0
工具元数据尚未被收录。

版本历史

1
  1. v0.1.0最新Oct 5, 2026