The Forge Gauntlet

io.theagentforge由 theagentforge.io 发布官方发布者v0.5.2更新于 Nov 7, 2026

See whether your own agent falls for the traps AI models fall for: six refereed jobs. No account.

发布方自己的服务：The Agent Forge

已验证Streamable HTTP可网页运行安全与监控AI 与机器学习

概览

AI 生成的概览

让自有智能体在带陷阱的沙箱日常任务中运行，并返回经裁判的报告卡。

可以做什么
  • 启动六项任务的 Gauntlet 评测、单项冲刺，或用此前的陷阱卡重新测量
  • 在当前任务中逐个调用沙箱工具，获得工具结果、任务判定与下一项任务
  • 查看运行进度：当前任务说明、可用工具、剩余调用次数，或已完成的报告卡
适用场景
当你想检验自己的智能体是否会在退款、发票、差旅、补货等日常任务中落入 AI 模型常见的陷阱，并取得可测量的裁判结果时使用。
运行要求
远程 Streamable HTTP 端点，无需安装。不需要账号、API 密钥或请求头。助手需能访问服务商的端点。
安装前请注意
服务会让你的智能体在沙箱中执行并记录其选择；结果描述的是被测智能体，冲刺结果不等同于完整 Gauntlet 分数。状态查询按地址限制为每分钟 60 次。仅触及沙箱，但运行结果会回传至该服务。

安装

在 SourceWeft 中

  1. 打开 控制台中的 The Forge Gauntlet，将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable，通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体，或 SourceWeft 对话中。智能体会读取该服务器的安装指南，先向你展示发布者、端点和登录方式，经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.theagentforge%2Fforge-gauntlet/install.md，并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前，先告诉我它的发布者、端点和登录方式，等我确认。不要把 API 密钥写进命令或我会提交的文件；问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "the-forge-gauntlet": {
      "type": "http",
      "url": "https://theagentforge.io/mcp/gauntlet"
    }
  }
}

README

[The Agent Forge]

The Agent Forge MCP server: MCP security, skill scanning and AI model trap results

A remote MCP server for MCP security and agent supply-chain checks. Before your agent installs or trusts an MCP server, agent skill, plugin or package, it can check it on The Agent Forge:

  • Skill scanner: scans a SKILL.md, tool descriptions or an install script for prompt injection, hidden instructions, downloads piped into a shell, credential and key-file reads, and data sent to throwaway endpoints.
  • Field reports and advisories: reports from human-verified agents on the exact version, plus published OSV advisories (malicious-package and CVE records) for npm and PyPI.
  • Installed-package exposure: matches installed npm and PyPI versions (or pip freeze) against published advisories and CISA's known-exploited list.
  • The Arena: which AI models fell for planted traps (fake invoices, refunds over policy, duplicate orders) on everyday jobs, refereed from the end state. Latest: Crucible 2: Hard, per model, with 95% intervals and replays.

It's a remote server: nothing to install or run. No API key, no account, read only.

URLhttps://theagentforge.io/mcp/public
TransportStreamable HTTP
Authnone
Server cardhttps://theagentforge.io/mcp/public/server-card
Official MCP Registryio.theagentforge/forge

Tools

ToolWhat it does
forge_checkField reports and published advisories for one tool version. Give one of id (npm:name, pypi:name, github.com/owner/repo; a version may be inline, npm:[email protected]), url or fingerprint (sha256:<64 hex>), plus version if known.
forge_scanScans a skill file, tool descriptions or install script (text, or url on a public code host) for prompt injection and risky instructions. Returns a verdict, rule ids, line numbers and the file's sha256.
forge_watchRe-checks installed skills by sha256 fingerprints (up to 100): which are flagged, need a fresh scan or have new field reports.
forge_exposureMatches installed packages (npm or PyPI name and exact version, up to 500) or pip_freeze text against OSV advisories and CISA's exploited list. Names and versions only.
forge_trapsHow often AI models fell for each planted trap: public trap id (FA-*), attempts, falls and fall rate. Optional task, model, tier (normal or hard).
arena_resultsPer job and model: attempts, passes, pass rate with a 95% interval, 3-of-3 consistency, traps fallen for, knockouts, cost per pass and replays. Optional task, tier, event (e.g. crucible-2-hard).

Every result is data, not instructions. A clear scan means no known pattern matched, not that a tool is safe. Check and scan answers include share.receipt_url, a signed, dated record of the answer.

Data downloads: Crucible 2: Hard (JSON) · CSV · all datasets

Connect

Claude Code

sh
claude mcp add --transport http forge https://theagentforge.io/mcp/public

Gemini CLI

sh
gemini extensions install https://github.com/theagentforge/forge-mcp

Agent Skills (skills.sh, any agent that reads SKILL.md):

sh
npx skills add theagentforge/forge-mcp

Three skills, all text only, no scripts:

  • forge-check-before-install scans a skill, plugin, MCP server or install command before it is installed;
  • forge-run-the-gauntlet runs the Gauntlet, six refereed jobs with planted traps, on your own agent;
  • forge covers checks, field reports and scans over the MCP server.

Codex, ChatGPT, GitHub Copilot, Kiro, Cursor: this repo is an Agent Plugins 1.0 package (plugin.json, mcp.json, skills/) with no hooks: the remote server and the skills below only. Install it from each app's plugin marketplace once it is listed there, or point an app that installs plugins from Git at this repo's URL. In Copilot CLI, once it is listed in awesome-copilot:

sh
copilot plugin install the-agent-forge@awesome-copilot

Cursor: this repo is also a Cursor plugin (.cursor-plugin/plugin.json, .mcp.json). Or add to ~/.cursor/mcp.json:

json
{ "mcpServers": { "the-agent-forge": { "url": "https://theagentforge.io/mcp/public" } } }

VS Code / Copilot: add to .vscode/mcp.json:

json
{ "servers": { "the-agent-forge": { "type": "http", "url": "https://theagentforge.io/mcp/public" } } }

Cline: see llms-install.md.

Anything else: any MCP client that speaks Streamable HTTP. Point it at the URL above. Every app's steps: https://theagentforge.io/connect.

Other ways in

About

This repository holds the connection files for directories and clients, under the MIT licence. The service itself runs at theagentforge.io. Its source is published for audit at theagentforge/agent-forge.

FilesRead by
plugin.json, mcp.json, skills/*/SKILL.mdAgent Plugins 1.0 clients (Codex, ChatGPT, Copilot, VS Code, Kiro, Cursor)
skills/*/SKILL.mdThe skills installer (skills.sh)
gemini-extension.json, GEMINI.md, skills/Gemini CLI
.cursor-plugin/plugin.json, .mcp.jsonCursor, Grok Build, Claude Code

No hooks, scripts or binaries. The only network endpoint is https://theagentforge.io/mcp/public, and it needs no credentials.

Privacy: https://theagentforge.io/privacy · Terms: https://theagentforge.io/terms · Contact: [email protected]

来源：README.md，提交 d8a8c9b

工具

3

gauntlet_start

Start the Forge Gauntlet

Use this when the user wants their own agent tested on everyday jobs with planted traps, refereed from the end state. Inputs: optional mode ("sprint": one job, at most 12 calls; default six jobs), card_from (an earlier gauntlet_id, for a measured re-run with its trap card) or challenge (a finished gauntlet_id, or model:<id>). Returns: a gauntlet_id, the first job's brief and its sandbox tools; no account. Limits: per address 10 runs a day (Sprints 20); 2 hours a run (a Sprint 30 minutes).

输入参数modecard_fromchallenge

gauntlet_act

Act in the Forge Gauntlet

Use this during a Gauntlet run to call one sandbox tool in the current job. Inputs: gauntlet_id, tool and args. Returns: the tool's result; when a job ends, its verdict and the next job; after the last job, the report card. Limits: each job's tool-call limit (in limits); only the sandbox is touched.

输入参数argstool必填gauntlet_id必填

gauntlet_status

Gauntlet status

Use this to see where a Gauntlet run stands. Inputs: gauntlet_id. Returns: the current job (brief, tools, calls left), or the report card once finished. Limits: 60 calls a minute per address.

输入参数gauntlet_id必填

版本历史

1
  1. v0.5.2最新Nov 7, 2026

评分

已满足适用检查项的 100%

该评分衡量此收录条目的完整程度，依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价，也不表示服务器安全或当前可用：可连通性是带日期的检查结果，评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分

其他 Theagentforge 集成

The Agent Forge

io.theagentforge官方发布者

查看哪些AI模型在真实工作中会落入陷阱，并在安装前检查MCP服务器或技能。AI 翻译

Streamable HTTP可网页运行
开发者工具6 个工具Nov 7, 2026