MCP Protocol Conformance

io.studiomeyerPublished by studiomeyer.iov0.2.2Updated Nov 3, 2026

MCP conformance test harness. JSON-RPC, OAuth 2.1 PKCE, schemas, smoke, annotations. CLI + lib.

The publisher's own server: StudioMeyer Crew

VerifiedSTDIODesktop onlyDeveloper ToolsSecurity & Monitoring

Overview

MCP Protocol Conformance's local MCP server, published by studiomeyer.io; no sign-in required; STDIO.

No AI overview yet: these facts come from the registry entry and the server itself.

Publisher
studiomeyer.io

Installation

In SourceWeft

  1. Open MCP Protocol Conformance in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

README

Part of the StudioMeyer MCP Stack — Built in Mallorca 🌴 · ⭐ if you use it

mcp-protocol-conformance

[npm version] [npm downloads] [License] [Last commit] [GitHub stars]

Conformance test harness for Model Context Protocol servers. Validates JSON-RPC 2.0 wire compliance, spec-version handshake, transport behaviour, OAuth 2.1 PKCE, tool schemas, capability advertisement, smoke roundtrip, and annotation hygiene against MCP spec 2024-11-05, 2025-03-26, 2025-06-18, and the current **stable** revision **2025-11-25** (experimental `tasks`, structured tool output, JSON Schema 2020-12 default, tool `title`/`icons`).

This is a Foundation build of the StudioMeyer MCP Factory: every other Factory build runs through this harness before promotion (npm publish, marketplace submit, upstream PR).

A note from us

We have been building tools and systems for ourselves for the past two years. The fact that this repo is small and has few stars is not because it is new. It is because we only just decided to share what we have built. It is not a fresh experiment, it is a long story with a recent commit.

We love building things and sharing them. We do not love social media tactics, growth hacks, or chasing stars and followers. So this repo is small. The code is real, it gets used, issues get answered. Judge for yourself.

If it helps you, sharing, testing, and feedback help us. If it could be better, an issue is more useful. If you build something with it, tell us at [email protected]. That genuinely makes our day.

From a small studio in Palma de Mallorca.

Install

bash
npm install --save-dev mcp-protocol-conformance

The package ships both a CLI (mcp-conformance) and a TypeScript library entry (import ... from "mcp-protocol-conformance").

CLI usage

Run against a stdio server

bash
mcp-conformance run \  --target stdio \  --cmd node \  --cmd-arg dist/server.js \  --spec 2025-06-18 \  --suite all \  --format terminal

Run against an HTTP server (Streamable HTTP, 2025-03-26+)

bash
mcp-conformance run \  --target http \  --url https://memory.studiomeyer.io/mcp \  --header "Authorization:Bearer ${TOKEN}" \  --spec 2025-06-18 \  --suite full \  --format json --out report.json

Run only a subset of suites

bash
mcp-conformance run --target stdio --cmd ./server --spec 2025-06-18 \  --suite jsonrpc,version,schema

Compare two manifests

bash
mcp-conformance compare \  --expected manifests/v1.json \  --actual   manifests/v2.json

Assert no breaking changes between two reports

bash
mcp-conformance assert-no-breaking \  --baseline reports/main.json \  --current  reports/pr-42.json

Exit codes: 0 clean, 1 failures, 2 invocation error.

Library usage

ts
import {  runFullSuite,  generateReport,} from "mcp-protocol-conformance";
const report = await runFullSuite(  { kind: "stdio", cmd: "node", args: ["dist/server.js"] },  "2025-06-18",  { suite: "all" },);
console.log(generateReport(report, "terminal"));if (report.status === "fail") process.exit(1);

MCP server usage

The harness is itself an MCP server. Start it over stdio and any MCP client can call its 12 tools:

bash
node dist/server.js

Tools (all read-only, all destructiveHint: false):

#ToolPurpose
1runJsonRpcComplianceJSON-RPC 2.0 error-code matrix + response-envelope (result/error mutual exclusivity)
2runSpecVersionAssertionVerify advertised protocolVersion
3runTransportSuiteTransport-layer ping + session-id
4runOauthPkceFlowOAuth 2.1 PKCE S256 (mock-AS or real-tenant)
5runToolSchemaValidationinputSchema (+ 2025-11-25 outputSchema / title) is valid JSON-Schema
6runCapabilityIntrospectioninitialize.capabilities matches behaviour (+ 2025-11-25 tasks)
7runRoundtripSmokeOne tools/call per advertised tool
8runAnnotationsAuditreadOnlyHint / destructiveHint hygiene
9runFullSuiteAll suites + summary
10generateReportRender JUnit / JSON / terminal
11compareManifestsDiff two tool manifests
12assertNoBreakingChangesDiff two FullReports

Compatibility matrix

2024-11-052025-03-262025-06-182025-11-25
jsonrpcyesyesyesyes
version (handshake)yesyesyesyes
transport (stdio)yesyesyesyes
transport (http)n/ayesyesyes
oauth (mock)n/ayesyesyes
oauth (real)n/ayesyesyes
schemayesyesyesyes
capabilityyesyesyesyes
smokeyesyesyesyes
annotationswarn-onlywarn-onlyyesyes
tasks (capability)n/an/an/ayes
tool title/outputn/an/an/awarn-only

yes = suite runs and produces actionable results. n/a = capability not in spec; suite skips automatically. warn-only = suite runs but the spec does not formally require the feature.

The 2026-07-28 RC (stateless core, SEP-2575/2567) is intentionally not here — it ships final on 2026-07-28; conformance for it lands in a later release against the final SDK.

Integration in Factory builds

In every Factory build's package.json:

json
{  "scripts": {    "factory:conformance": "mcp-conformance run --target stdio --cmd 'node dist/server.js' --spec 2025-06-18 --suite full"  }}

In CI:

yaml
- run: npm run factory:conformance

Spec references

About StudioMeyer

StudioMeyer is an AI and design studio based in Palma de Mallorca, working with clients worldwide. We build custom websites and AI infrastructure for small and medium businesses. Production stack on Claude Agent SDK, MCP and n8n, with Sentry, Langfuse and LangGraph for observability and an in-house guard layer.

License

MIT — Copyright (c) 2026 Matthias Meyer (StudioMeyer)

Source: README.md at commit 4d9fcb5

Tools

0
SourceWeft started this package once in an isolated sandbox, without credentials, to list its tools. That failed: the server did not start.

Version history

2
  1. v0.2.2LatestNov 3, 2026
  2. v0.2.1Sep 16, 2026

Score

50% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 days25 pts

    Keep the endpoint answering the MCP handshake; SourceWeft probes it every 30 days.

  • Auth declared10 pts

    Declare the credential headers in the registry entry, or keep the endpoint answering the probe so its auth can be classified.

  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts

Other Studiomeyer integrations