CrawlWitness

com.crawlwitnessPublished by crawlwitness.comOfficial publisherv1.0.52Updated Nov 2, 2026

AI consent & licensing check for any domain, with signed on-chain receipts. Paid via x402.

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingFinanceSecurity & Monitoring

Overview

AI-generated overview

Remote oracle that tells an assistant whether a domain's content may be used for AI training, RAG or search, with signed on-chain receipts.

What you can do
  • Check AI consent and licensing signals for a domain: robots.txt rules per AI bot, RSL licenses, IETF AIPREF, W3C TDMRep, noai meta tags, llms.txt and C2PA, scored 0-100 with a training stance.
  • Get a fast yes/no verdict for one domain, one AI bot and one use (train, rag or search), with reasons and a signed receipt.
  • Look up what a domain's robots.txt, llms.txt, tdmrep.json, RSL license or homepage headers said at a past instant, with version hashes.
  • Verify a paid query's signed attestation and its Merkle proof and on-chain attestation.
  • Screen a crypto address against the US OFAC SDN sanctions list before paying or interacting with a wallet.
When to use it
Use it before crawling a site, training on its content or ingesting it into a RAG pipeline, when you need a documented, verifiable record of what the site allowed and when. Also useful for auditing a domain's AI-consent signals or checking a wallet against sanctions before an agent transacts.
Requirements
Remote streamable HTTP endpoint; no account or API key declared. Paid tools are settled in USDC via x402 on Base or Solana, so a funded wallet and x402-capable client are needed for those; the score, history and receipt-verification tools are free. Network access required.
Before you install
Some tools cost money per call (a micro-fee in USDC via x402), so an assistant can spend funds without a separate confirmation step. Queries send the domain or wallet address you are checking to a third-party service. Verdicts are advisory signals from public documents, not legal advice.

Installation

In SourceWeft

  1. Open CrawlWitness in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/com.crawlwitness%2Foracle/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "crawlwitness": {
      "type": "http",
      "url": "https://api.crawlwitness.com/mcp"
    }
  }
}

Tools

6

can_ai_use

Can this AI bot use this site? (paid yes/no, signed)

Fast yes/no verdict for one domain, one AI bot and one use (train, rag or search), from robots.txt, IETF AIPREF, W3C TDMRep, noai directives and RSL licenses, with the reasons and a signed receipt. Use it in a crawler or RAG pipeline before fetching each new domain. Costs 0.001 USD on Base (0.002 on Solana) via x402. Invalid domain or unknown bot is never charged.

Parametersbotrequiredusedomainrequired

signal_history

Signal history on any date (free)

What a domain's robots.txt (or llms.txt, tdmrep.json, RSL license, homepage headers) said at a given instant, with the SHA-256 of each version and its EAS attestation anchored on Base. Without `source` it returns the index of versions; with `source` (and optional `at`, RFC 3339) the document in force at that instant. Covers only domains already analysed.

Parametersatdomainrequiredsource

verify_receipt

Verify a receipt (free)

Returns the signed EAS attestation of a paid query and, once anchored, its Merkle proof (OpenZeppelin format) and the on-chain attestation on Base that contains it.

Parametersuidrequired

check_wallet

Is this crypto wallet sanctioned? (paid, signed)

Sanctions screening of a crypto address against the US OFAC SDN list (all its digital-currency addresses: EVM, BTC, TRX, SOL, USDT, USDC…). Use it before an agent pays, receives from or interacts with a wallet. Returns sanctioned true/false, the listed entity and programs, the exact list version used and a signed receipt. Costs 0.005 USD via x402. Screening aid, not legal advice.

Parametersaddressrequired

Version history

1
  1. v1.0.52LatestNov 1, 2026

Score

83% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.