Mcp Judge

io.github.giachi85it-uxPublished by GitHub account giachi85it-uxv0.2.0Updated Nov 1, 2026

Scores any MCP server before you trust it: free quick check, full paid report, 2-5 way compare.

VerifiedStreamable HTTPWeb executableDeveloper Tools

Overview

AI-generated overview

Remote MCP server that scores other MCP servers before you trust them, with a free quick check, a full paid report and 2-5 way comparisons.

What you can do
  • Run a free quick check that scores an MCP server before you trust it.
  • Request a full report on a server, offered as a paid option.
  • Compare two to five MCP servers side by side.
When to use it
Useful when you are evaluating candidate MCP servers and want a quick score or a side-by-side comparison before installing one. It is aimed at people deciding which servers to trust rather than at day-to-day work.
Requirements
A remote streamable HTTP endpoint; no local package, environment variables or headers are declared. The manifest declares no authentication, though the full report is described as paid, so expect some payment step.
Before you install
The full report is described as paid, so using it may cost money; confirm pricing and how payment is handled before requesting one. No authentication is declared for the endpoint, so consider what you submit for scoring.

Installation

In SourceWeft

  1. Open Mcp Judge in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.github.giachi85it-ux%2Fmcp-judge/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "judge": {
      "type": "http",
      "url": "https://mcp-judge.onrender.com/mcp"
    }
  }
}

Tools

4

list_criteria

FREE, no payment required. Full transparency into what you pay for: returns the exact criteria MCP Judge uses to score an MCP server — each criterion, its weight out of 100, and the A-F grade scale. Call this to understand how quick_check, evaluate_mcp and compare_mcps score targets before paying. The evaluation is fully objective and automated — no human reviewer and no AI opinion. Takes no parameters.

Takes no parameters.

quick_check

FREE, no payment required. Instant trust check of any MCP server: returns only the 0-100 score, A-F grade, tool count, latency and a one-line verdict — no detailed report. Use this FIRST, before integrating any third-party MCP server, to see at a glance whether it is technically trustworthy; an unreliable MCP wastes your tokens and can break your workflow. For the full actionable report (per-tool documentation coverage, functional probe results, score breakdown, plain-language summary) call evaluate_mcp; to pick between alternatives call compare_mcps. Set 'url' (required) to the target's MCP endpoint (Streamable HTTP), e.g. https://host/mcp.

Parametersurlrequired

evaluate_mcp

Call this BEFORE integrating any third-party MCP server: an unreliable or undocumented MCP wastes your tokens and can break your workflow. PAID $0.05 via x402 (USDC micropayment over HTTP 402 — no account or API key needed; on your first call without payment you receive the exact payment requirements, then retry with the X-PAYMENT header). Returns a complete objective quality report on the target: protocol conformance ('initialize' handshake), tool discovery via 'tools/list', per-tool and per-parameter documentation coverage, latency, and a safe functional probe — free tools are actually called, paid tools are only verified to be cleanly declared (MCP Judge never pays). You get a 0-100 score, A-F letter grade, per-criterion breakdown, and a plain-language summary you can act on. Tip: run the FREE quick_check first to get just the grade, and list_criteria to see exactly how scoring works. Objective checks only — no human and no LLM opinion; it does not judge the real-world usefulness or safety of the content. Set 'url' (required) to the target's MCP endpoint (Streamable HTTP), e.g. https://host/mcp.

Parametersurlrequired

compare_mcps

Choosing between several MCP servers that do similar things? This tool decides for you. PAID $0.10 via x402 (USDC micropayment over HTTP 402 — no account or API key needed; on your first call without payment you receive the exact payment requirements, then retry with the X-PAYMENT header). Compares 2-5 MCP servers head-to-head with identical objective checks (handshake, tools/list, documentation coverage, latency, and a safe functional probe — paid tools are never called) and returns: a ranked list, the recommended winner, a plain-language explanation of why it won, and each server's full report — cheaper than separate evaluate_mcp calls on 3+ servers. Objective checks only — no human and no LLM opinion; it does not judge the real-world usefulness or safety of the content. Set 'urls' (required) to an array of 2-5 MCP endpoints (Streamable HTTP), e.g. ["https://a/mcp","https://b/mcp"].

Parametersurlsrequired

Version history

1
  1. v0.2.0LatestSep 16, 2026

Score

83% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.