Desvela ARD Registry — free preflight(domain)

dev.desvelaPublished by desvela.devOfficial publisherv0.1.0Updated Oct 24, 2026

What a domain publishes for AI agents: ai-catalog.json, llms.txt, agents.md, robots.txt rules. Free.

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingDeveloper ToolsSecurity & Monitoring

Overview

AI-generated overview

Lets an assistant inspect what a domain publishes for AI agents, watch it for changes, test CDN blocking, and search an index.

What you can do
Four tools. preflight reports what a domain publishes for AI agents: ai-catalog.json, llms.txt, agents.md and robots.txt directives for AI bots, plus a visibility receipt. watch subscribes to a domain and sends a signed webhook when those files change. crawler_block_test sends each AI crawler's real user-agent to the homepage and compares the CDN response with a browser's. search runs natural-language queries over the Desvela index of agents, MCP servers and registries.
When to use it
Use it before letting an AI agent visit a domain, to see what that domain publishes for AI agents, or to keep track of changes to those files over time. It also suits looking up agents, MCP servers and registries already indexed by Desvela.
Requirements
Remote MCP endpoint reached over streamable HTTP; no local package to install. The input declares no authentication, environment variables or headers. watch returns a webhook, so a receiving endpoint is needed.
Before you install
watch creates a subscription and pushes change notifications to a webhook, so confirm the receiving endpoint and how the signature is verified. crawler_block_test sends requests to the target domain. search and watch rely on Desvela's index and service, so queries go to a third party.

Installation

In SourceWeft

  1. Open Desvela ARD Registry — free preflight(domain) in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/dev.desvela%2Fregistry/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "desvela-ard-registry-free-preflight-doma": {
      "type": "http",
      "url": "https://registry.desvela.dev/mcp"
    }
  }
}

Tools

4

preflight

Preflight a domain

What a domain publishes for AI agents before you touch it: ai-catalog.json (ARD), llms.txt, agents.md, and its robots.txt directives for AI bots (GPTBot, ClaudeBot, Google-Extended…). Includes a visibility receipt: surface-by-surface state, the words that would find the domain in search (or the honest fact that none would), what is missing and where to publish it. Served from the Desvela ARD index when fresh (<7 days), live-checked otherwise. Free.

Parametersdomainrequired

watch

Watch a domain for agent-surface changes

Subscribe to a domain: get a signed webhook (X-Desvela-Signature, HMAC-SHA256) when what it publishes for AI agents changes — ai-catalog.json entries added/changed/gone, llms.txt or agents.md edited or removed, robots.txt AI-bot directives changed. Checked weekly against the Desvela ARD index. Returns a manage_token (GET/DELETE https://registry.desvela.dev/watch/{id}) and the signing secret — store both.

Parametersdomainrequiredwebhook_urlrequired

crawler_block_test

Test what a domain actually serves AI crawlers

What the domain's CDN really does, as opposed to what its robots.txt says. Sends each AI crawler's real user-agent at the homepage and compares the response against a browser: a site can allow GPTBot in robots.txt and still have its CDN answer it a 403, and robots.txt cannot tell you that. Verdicts per crawler: ok, blocked, throttled (429, which is "too fast" and not "not you"), degraded (a 200 with a fraction of the bytes, the shape of a JS-gated page), or error. When `measurable` is false the site refused the control request too and there is no verdict to give. Live probe, ~6 requests. Free. Use preflight for the declared policy; use this for the observed one.

Parametersdomainrequired

Version history

1
  1. v0.1.0LatestSep 16, 2026

Score

72% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts

    Publish an icon in the registry entry.

  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.

Other Desvela integrations

AI Brand Watch by Desvela

dev.desvela

A remote MCP server that tracks a brand's share of voice across ChatGPT, Claude, Perplexity and Gemini, billed per check through Apify.

Streamable HTTPWeb executableAuth
Data & AnalyticsCredential requiredOct 24, 2026