
MCP Test Utils
io.github.JeenyJAI由 GitHub 账号 JeenyJAI 发布v3.27.23更新于 Oct 27, 2026
Desktop UI automation for AI agents: verified clicks, UI Automation, OCR, scenario runs, recording
概览
Windows 桌面 UI 自动化服务器,让 AI 助手看到屏幕、点击输入、读取 UI Automation 树,并回放已保存的测试场景。
- 可以做什么
- 截取整个桌面或指定窗口,并用 OCR 读取屏幕文字
- 列出、聚焦、启动和关闭窗口,检查 UI Automation 元素树、焦点与文档文本
- 点击、移动、拖拽、滚动,输入 Unicode 文本并按键或快捷键,可选输入锁定
- 等待窗口或元素,批量执行最多 20 个调用,录制草稿场景并回放场景、套件或数据行并给出通过/失败报告
- 检查无障碍缺陷,读取被测进程的内存、句柄与 CPU 数据
- 在允许目录内按文本或正则搜索、按通配符查找文件,并可选记录会话日志
- 适用场景
- 适合在 Windows 上做桌面自动化 QA 与回归测试:驱动应用走完流程、逐步截图、在构建后或 CI 中回放已保存场景、把手工操作录成测试草稿,以及做无障碍与资源泄漏检查。
- 运行要求
- 仅支持 Windows x64,暂无 macOS 或 Linux 版本。只需下载单个 exe,由 MCP 客户端通过 stdio 启动,无需运行时或安装程序。可选环境变量开启功能:MCP_LOG_DIR 启用日志工具,MCP_SEARCH_DIRS 启用文件搜索,MCP_LAUNCH_APPS 启用 launch_app,另有 MCP_NOTIFY、MCP_INPUT_LOCK 和 MCP_INPUT_LOCK_STALL_MS。场景超过 50 步需要许可证密钥。
安装
在 SourceWeft 中
- 打开 控制台中的 MCP Test Utils,将其添加到工作区。
- 为需要使用其工具的对话启用该服务。
Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。
其他 MCP 客户端
参照 仓库 中的启动说明。
README
MCP Test Utils
[version: 3.27.23] [tools: 31]
MCP server for automated desktop UI testing. A single binary — no runtime, no dependencies, no installer.
Windows x64 only. There are no macOS or Linux builds yet. If you need one, write to [email protected]: requests decide what comes next.
Gives AI agents eyes and hands: screenshots, window management, mouse, keyboard, UI Automation, OCR, file search. Replays saved scenarios as regression runs — after every build, without an agent. Records what you do into a draft scenario, checks accessibility, watches the resources of the application under test.
Why
AI agents can trigger actions in applications but can't see the screen. This server bridges that gap:
Fully autonomous, no user involvement required.
Demo
Setup
- Download
mcp-test-utils.exefrom Releases (the.sigfile next to it is for the built-in updater — you do not need it). - Add it to your MCP client:
Claude Desktop: %APPDATA%\Claude\claude_desktop_config.json
Claude Code:
For other clients, see their documentation.
- Restart the client.
- In chat, try: "Take a screenshot" — the agent will return an image of your desktop.
Optional settings (logging, file search, starting programs) go into env — see
Environment variables:
Tools (31)
Four of them appear only when configured: search_in_files and find_files with MCP_SEARCH_DIRS,
enable_logging and disable_logging with MCP_LOG_DIR — by default the server lists 27 tools.
Vision
Window management
Input
Structured UI access
Process
Waiting, batching and scenarios
File search
Agent guide
Session logging
Regression runs without an agent
An agent finds a path through your application once and saves it as a scenario — a JSON file. After that the scenario replays without an agent: fast, the same way every time, no tokens spent.
- Exit codes:
0— passed,1— a step failed,2— did not run. Ready for a CI job after each build. - On a failure you get a screenshot, the element tree and a hint: either the scenario is stale or the application has changed.
- An agent runs a scenario with
run_scenario(path)and learns the format fromget_usage_guide(section: "scenarios"). - Suites and data rows:
--suiteruns several scenario files in order with one summary;--data rows.csvruns a scenario once per row (columns become variables);--junit report.xmladds JUnit XML for CI. - Without a license key a scenario runs up to 50 steps (see License key).
Recording
Do the steps yourself and get a draft scenario instead of describing them to an agent:
Only that window and its dialogs are recorded, with a notice on screen; Ctrl+Alt+Shift+R (or Enter in the
console) stops the recording. Password fields are never read; text typed into a terminal is recorded only with --keys-text. An
agent can start the same recording with record_scenario.
Environment variables
Tray icon, updates and input lock
- A tray icon shows a live log of tool calls, one tab per session, errors in red;
MCP_NOTIFY=offhides it. - Updates: tray menu → Check for updates…. Only a release signed by the author is installed; afterwards restart your MCP client. The server goes online only when you click.
- Input lock: while the server types or clicks, your keyboard and mouse buttons are paused (the pointer still
moves). Press Esc to stop the action and get your input back.
MCP_INPUT_LOCK=offturns the lock off.
Feedback
If an agent hits a gap in the tools, it offers to prepare a short suggestions file (prepare_feedback). The file
goes to Documents\mcp-test-utils feedback\, with personal data masked and no screenshots; review it and email it
to [email protected]. Nothing is sent automatically.
Use cases
- Automated QA — the agent navigates the app, clicks through flows, takes screenshots at each step, writes a test report
- Regression runs — replay saved scenarios after each build, from a script or a CI job, without an agent
- Recorded tests — walk through a path yourself once, get a draft scenario, let the agent turn it into a test
- Desktop automation — fill forms, copy data between windows, run workflows
- Accessibility audit —
check_accessibilityfinds unnamed controls, controls the Tab key cannot reach, duplicate ids - Resource leaks —
process_infoshows handles and GDI objects growing across repeated calls - Visual checks — the agent compares screenshots between builds
- Data extraction — read document text through UI Automation, or OCR text from applications that don't expose it
- Code search — find patterns across multiple projects without leaving the agent session
Security
- Responds only to requests from the MCP client; opens no network ports
- Writes files only when you ask: logs, scenario reports and JUnit files, recorded drafts, sealed scenarios, the
feedback file, the license file — plus small settings files in
%LOCALAPPDATA%\mcp-test-utils\and an update you install - Sends no data externally; goes online only when you click Check for updates (and Download and install) in the tray window — an agent's tool call never does, and only a file signed by the author is installed
- Holds your keyboard and mouse buttons only during a call,
batchor scenario run that sends input — Esc releases them at once - Starts only the programs you list in
MCP_LAUNCH_APPS(never shells or interpreters); a forcedclose_windowterminates only a program it started - Records only on an explicit command, with a notice on screen the whole time; password fields are never read
- Screenshots capture the entire screen — make sure no sensitive information is visible
- File search is sandboxed — only directories in
MCP_SEARCH_DIRSare accessible
How it works
MCP Test Utils is an MCP server over stdin/stdout: your MCP client starts the exe and calls its tools. It uses native Windows APIs (UI Automation, Win32 input, Windows OCR) — no PowerShell, no helper tools, no network access except the update check you start. Tested with Claude Desktop and Claude Code.
License key
All tools are free. A license key only lifts the 50-step limit of scenario runs.
For now, keys are issued through early access: the first 30 users get a free one-year key in exchange for short
feedback after the first month — write to [email protected] with your email and the
machine code of your computer. A key is bound to that computer. Your agent sees the code in the second line of
get_usage_guide, or print it yourself:
Register the key once on that computer:
Reinstalling Windows or replacing the motherboard alone keeps the key valid; a new computer needs a new key — just write again.
A sealed scenario runs anywhere without the limit — that file only, exactly as sealed. On the licensed computer
mcp-test-utils --seal order-form.json writes a seal into the file; a CI agent or a colleague without a key then
runs it in full. Any change to its steps (or to the files it includes) breaks the seal — seal it again on the
licensed computer.
Support us
If you find it useful — jeenyjai.github.io
License
Copyright 2026 JeenyJAI. All rights reserved.
🚀 Created with Claude
来源:README.md,提交 10459aa
工具
0版本历史
4- v3.27.23最新Oct 19, 2026
- v3.26.43Oct 16, 2026
- v3.25.1Sep 23, 2026
- v3.10.1Sep 16, 2026
评分
已满足适用检查项的 40%
该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。
- 近 30 天内可连通25 分
请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。
- 已声明认证方式10 分
请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。
- 已列出工具15 分
请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。
- 描述必需15 分
- 图标10 分
- 文档15 分
- 许可证10 分
请在仓库或注册中心条目中声明许可证。