Litmus

io.github.polygraphso由 GitHub 账号 polygraphso 发布v0.36.0更新于 Nov 2, 2026

Grade MCP servers A to F with the open behavioral litmus. npm: full toolset; hosted: lookups only.

已验证Streamable HTTP可网页运行开发者工具安全与监控

概览

AI 生成的概览

Litmus 用开放的行为测试框架给 MCP 服务器打 A–F 等级,并让助手查询已发布等级、申请评级、验证链上证明。

可以做什么
  • 查询 MCP 服务器的已发布等级,并按等级分页列出已评级服务器
  • 申请评级(一次性付费)并读取已发布等级背后的链上证明
  • 立即对某个服务器运行完整 litmus 测试,把等级和证据返回给助手
  • 用独立的静态扫描给 Claude Code 或 Agent Skill 评级
  • 也可作为命令行工具和 GitHub Action 使用,在等级为 D/F 时让构建失败
适用场景
适合在推荐或安装某个服务器前,让助手先查它的已发布等级;也适合需要自行评级服务器或技能并取得可复现证据的场景。仅做查询时用托管端点即可,评级则需要本地安装。
运行要求
使用托管远程端点(仅查询)或本地 npm 包 @polygraphso/litmus(stdio,完整工具集)。本地安装需要 Node.js 与 npx;沙箱出网探测需要 Docker(没有 Docker 会跳过一项探测,等级最高为 B)。可选环境变量 NEXT_PUBLIC_POLYGRAPH_NETWORK(base 或 base-sepolia)和 POLYGRAPH_API_URL。需要访问 polygraph.so 的网络。
安装前请注意
评级会运行目标服务器的代码,只对信任的目标评级;出网虽在 Docker 沙箱中,但仍会执行代码。request_grade 涉及一次性付费并返回付款链接。GitHub Action 的 bearer 输入会作为 Authorization 头发送给目标,只应用于可信且固定版本的远程服务。等级是测量结果,不是保证。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Litmus,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.polygraphso%2Flitmus/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "litmus": {
      "type": "http",
      "url": "https://polygraph.so/api/mcp"
    }
  }
}

README

[polygraph]

litmus

The open behavioral litmus harness for MCP servers — grade A–F, reproducible.

Grade a server in one command

bash
# -p is required: the package ships three bins, so npx must be told which to runnpx -y -p @polygraphso/litmus polygraphso-litmus litmus npm/@modelcontextprotocol/server-filesystem

Point it at an npm ref, a pypi ref, a github/owner/repo ref (cloned, built, and run sandboxed — Docker required; the grade pins the commit SHA), an https:// MCP endpoint, or a local entry file. The harness connects the way an agent would, fingerprints the exact tool surface, runs the four probe categories, and prints the grade with the findings behind it — plus a deterministic evidence bundle on disk. It runs the target's code (egress is Docker-sandboxed; without Docker, C-02 is skipped and the grade caps at B), takes ~20–60s, and exits non-zero on D/F so it scripts anywhere. To dispute any published grade, re-run this same command against the same server — open and deterministic means a re-run reproduces the grade, or refutes it.

Looking up a grade someone already published takes under a second and runs nothing: the polygraph.so index, or check_server from the MCP tools below.

[litmus grading npm/@modelcontextprotocol/server-filesystem — five probe steps, then grade: A]

Use it from your agent — MCP server + plugin

For grade lookups, point any MCP client at polygraph's hosted endpoint, no install:

bash
claude mcp add --transport http polygraph https://polygraph.so/api/mcp

or the raw config:

json
{ "mcpServers": { "polygraph": { "url": "https://polygraph.so/api/mcp" } } }

This serves the lookup tools only (check_server, list_servers, request_grade); grading a server yourself (run_litmus, run_skill_litmus) executes its code, so it needs the local stdio install below.

The package also ships a stdio MCP server (polygraphso-litmus-mcp) with the full toolset, for any MCP-capable client:

  • check_server — read a server's published grade in under a second (no execution); the pre-flight check before recommending or installing a server.
  • list_servers — servers with a published grade, A first; paged (default 25 per call, with grade/limit/offset filters and a full-corpus summary).
  • request_grade — record a grade request with polygraph.so ($1 one-time fee; graded within 48h of payment — the response carries the payment link).
  • run_litmus — grade a server now: the full harness, grade + evidence returned to the agent.
  • run_skill_litmus — grade a Claude Code / Agent Skill (static scan, A/B/D/F).
  • verify_attestation — read the onchain proof behind a published grade (EAS on Base).

In Claude Code, the plugin wires the server plus two commands in one step:

/plugin marketplace add polygraphso/litmus/plugin install polygraph@polygraphso

then /polygraph:grade <server> and /polygraph:check <server>. Cursor and manual JSON setups are on polygraph.so; full tool docs in packages/litmus/README.md.

Gate your CI on MCP grades — GitHub Action

Fail a build when an MCP server or an Agent Skill it ships grades D/F under the open behavioral litmus. For servers it is hybrid — a fast lookup of the published grade, then the harness when ungraded; for skills it is a fast static scan. Un-gradeable targets warn unless strict.

It's on the GitHub Marketplace as polygraphso/litmus@v1. For a security gate, pin to a commit SHA rather than the mutable @v1 tag:

yaml
# .github/workflows/mcp-gate.ymlname: mcp-gateon: [pull_request]            # NOT pull_request_target — that exposes secrets to fork PRspermissions:  contents: readjobs:  gate:    runs-on: ubuntu-latest    steps:      - uses: actions/checkout@v5      - uses: polygraphso/litmus@<commit-sha>   # pin to a SHA; resolve from the v1 release        with:          # Name the targets explicitly (recommended). Grading runs a server's code,          # so on a public repo prefer an allowlist over discovering PR-controlled config:          servers: |            npm/@modelcontextprotocol/server-filesystem          skills: |            ./my-skill          # discover: "true"  # opt in to auto-discovery (.mcp.json/.vscode/.cursor) — trusted repos only          # min-grade: B      # stricter than the default D/F gate          # strict: "true"    # also fail on targets that cannot be graded

Inputs: servers · skills · discover (default false) · min-grade · strict · working-directory · version · bearer. Outputs: result · failed · report.

Security. Grading a server runs its code (egress is Docker-sandboxed, but it still executes). Trigger on pull_request, never pull_request_target. Keep discover off on public repos and name targets explicitly — auto-discovered config is pull-request-controllable. bearer is sent as an Authorization header to the target, so pass it only for an explicitly trusted, pinned remote — never with discovery or on untrusted PRs, and keep it scoped and short-lived.

Not on GitHub? The gate is a plain command — npx @polygraphso/[email protected] ci (pin the version) — so it runs in any CI or as a pre-commit hook. A grade is a measurement, not a guarantee: re-run the open harness to reproduce any result.

What litmus is

This is the source for @polygraphso/litmus, the open behavioral litmus harness for MCP servers from polygraph.so.

The harness connects to an MCP server the way an agent would, fingerprints its exact tool surface, and runs four probe categories — C-01 tool-output injection (static, dynamic, and second-order — one tool's output weaponized as another's input), C-02 permission/egress (in a hardened default-deny Docker sandbox, matched host and port), C-03 sensitive-data handling (planted canaries), C-04 adversarial-input handling (malformed/oversized and jailbreak inputs) — then grades the server A–F. A passing grade is a measurement, not a guarantee; the methodology and its disclosed limits are at polygraph.so (the open source here is the ground truth).

Alongside the grade, an npm target's dependency tree is checked against the osv.dev vulnerability database and any vulnerable dependencies are reported as dependency advisories. This is a separate, point-in-time signal — it is advisory only: it never affects the A–F grade and is not part of the reproducible evidence (vulnerability data changes over time, so folding it into the grade would break re-run reproducibility). It applies to npm targets only; other target kinds report it as skipped. Resolution runs npm install --package-lock-only --ignore-scripts, which resolves the tree without downloading tarballs or running any package code. Opt out with --no-deps-audit (or LITMUS_DEPS_AUDIT=0).

The same package also grades Claude Code / Agent Skills (a SKILL.md + bundle) under a separate static litmus (litmus-skill-v3): a deterministic byte-scan — S-01 prompt injection, S-03 data-exfiltration instructions, S-04 dangerous commands in the SKILL.md body or bundled scripts (incl. base64-obfuscated curl | bash) — graded A/B/D/F and anchored by a whole-directory content hash, plus a separate advisory quality signal. It is static (no execution): an A is static-clean, not behavioral proof. See packages/litmus/README.md.

The hosted, operator-run grading service is not in this repo — it lives in a separate private repo and consumes this package from npm like any other client.

Layout

This is a pnpm monorepo. Only @polygraphso/litmus is published; the @polygraph/* packages are private building blocks that tsup bundles into it.

packages/  litmus/          # @polygraphso/litmus — the only published package (lib + 3 bins: CLI, skill CLI, MCP)  core/            # contract types, canonical JSON, identity helpers  probes/          # the harness: connect, fingerprint, grade, probe runners, sandbox  onchain/         # EAS attestation read + encode/decode (Base) — read-only, no minting  agent/           # agent-gate decision logic + live-fingerprint recheck  mcp/             # MCP server wrapper  cli/             # CLI commands + target/auth resolution  demo-*-mcp/      # demo MCP servers used as test fixtures

See packages/litmus/README.md for the npm-facing usage docs, and polygraph.so for the methodology and proof format.

Develop

bash
pnpm installpnpm -r typecheckpnpm -r testpnpm --filter @polygraphso/litmus build   # → packages/litmus/dist

Release

@polygraphso/litmus is versioned in packages/litmus/package.json. Tag to publish:

bash
git tag litmus-v<x.y.z> && git push origin litmus-v<x.y.z>

The Publish @polygraphso/litmus workflow builds, typechecks, tests, and publishes with npm provenance. See CONTRIBUTING.md for the full process and the local-development workflow for downstream consumers.

License

Apache-2.0 — © polygraph.so.

来源:README.md,提交 8e9f9d5

工具

0
SourceWeft 尚未读取此服务器的工具。

版本历史

1
  1. v0.36.0最新Sep 16, 2026

评分

已满足适用检查项的 85%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分