agentbuilt

dev.agentbuiltPublished by agentbuilt.devOfficial publisherv1.0.1Updated Oct 27, 2026

Free AI-readiness audit of any URL: AI crawler rules, JS-free text, JSON-LD, llms.txt. Tool catalog.

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingData & AnalyticsBusiness & Commerce

Overview

AI-generated overview

Remote MCP server that audits how readable a URL is to AI crawlers and assistants, and lists agentbuilt's pay-per-result data tools.

What you can do
  • Audit a URL for AI readiness: robots.txt rules for GPTBot, ClaudeBot, PerplexityBot and Google-Extended, text available without JavaScript, JSON-LD types, llms.txt, sitemap, canonical and meta description, returning a score, findings and fixes
  • Browse the agentbuilt catalog of pay-per-result data tools, including what each does, when to use it, its limits and its cost
  • Request a human-readable AI visibility audit that asks buyer questions to ChatGPT, Perplexity, Gemini and Claude and emails back a report on mention and citation rates
When to use it
Useful when checking whether a site can be read and cited by AI assistants, or when comparing crawler access and structured data across pages. Also handy for discovering agentbuilt's paid data tools before wiring them into a pipeline.
Requirements
Remote Streamable HTTP endpoint at agentbuilt.dev; no package, API key or environment variable needed for the free tools. The visibility audit request needs an email address and explicit consent from the person being acted for.
Before you install
The visibility audit request sends an email address and triggers double opt-in, so only call it with the user's explicit consent. The catalog lists paid, pay-per-result tools; costs are described but nothing is purchased through this server. The audit fetches arbitrary URLs on the server's behalf.

Installation

In SourceWeft

  1. Open agentbuilt in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/dev.agentbuilt%2Fagentbuilt/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "agentbuilt": {
      "type": "http",
      "url": "https://agentbuilt.dev/api/mcp"
    }
  }
}

README

agentbuilt MCP server

A small, stateless Model Context Protocol server that gives any AI agent a free AI-readiness audit of a URL, plus an A2A endpoint exposing the same capability as an agent. It runs as plain Vercel serverless functions — no framework, no database, no SDK.

Live endpoint: https://agentbuilt.dev/api/mcp (Streamable HTTP, protocol 2025-06-18). Listed in the official MCP registry as dev.agentbuilt/agentbuilt.

Tools

ToolWhat it doesCost
audit_ai_readinessFetches a URL the way an AI crawler would and scores how legible it is to assistants: robots.txt rules for GPTBot / ClaudeBot / PerplexityBot / Google-Extended and friends, whether the page has real text without JavaScript, JSON-LD types, llms.txt, sitemap, canonical, meta description, FAQ schema. Returns a score, findings and concrete fixes.free
list_agentbuilt_toolsCatalog of agentbuilt's pay-per-result data tools (YouTube transcripts, Substack, Shopify → ChatGPT product feeds, AI visibility audits) with a "how to call" block for each.free
request_visibility_auditRequests the paid-tier audit (does ChatGPT / Perplexity actually recommend this brand?) — requires explicit consent and double opt-in by email.free to request

Use it from a client

Claude.ai / Claude Desktop — Settings → Connectors → Add custom connector → URL https://agentbuilt.dev/api/mcp.

Cursor — .cursor/mcp.json:

json
{ "mcpServers": { "agentbuilt": { "url": "https://agentbuilt.dev/api/mcp" } } }

VS Code — .vscode/mcp.json:

json
{ "servers": { "agentbuilt": { "type": "http", "url": "https://agentbuilt.dev/api/mcp" } } }

curl

bash
curl -s https://agentbuilt.dev/api/mcp -H 'content-type: application/json' -H 'accept: application/json' \  -d '{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"audit_ai_readiness","arguments":{"url":"https://example.com"}}}'

A2A — agent card at https://agentbuilt.dev/.well-known/agent-card.json; message/send to https://agentbuilt.dev/api/a2a with a message containing a URL.

Why the readiness check is built the way it is

  • SSRF-safe fetching (api/_lib/net.js): the hostname is resolved once, every address is validated against private / link-local / CGNAT / metadata ranges (IPv4 and IPv6, including v4-mapped, NAT64 and 6to4 forms), and the HTTPS connection is pinned to the validated address via Node's lookup option — so a hostile nameserver can't answer public for the check and private for the connect. Redirects are followed manually and re-validated per hop. Only ports 80 and 443.
  • Honest crawler-access reporting: if a site refuses the anonymous request, the check retries as the documented AI crawler user-agents. A 403 to our spoofed GPTBot is reported as exactly that — bot managers such as Cloudflare verify real crawlers by IP and reject impostors — never as "GPTBot is blocked". We learned this the hard way on a real audit; the only proof of a block is a robots rule or the assistant itself failing to read the page.
  • Real-JSON / real-XML probes: a SPA that returns 200 HTML for /llms.txt or /sitemap.xml is not counted as having them.
  • Stateless: no sessions, no storage for the free tool. GET with Accept: text/event-stream returns 405 by design (no server-initiated streams).

Deploy your own

Fork, vercel deploy. The free tools need no environment variables. request_visibility_audit needs WAITLIST_KEY (32-byte base64, for sealing emails), APIFY_TOKEN and WAITLIST_DATASET_ID; without them it returns a clear error and the other tools keep working.

server.json is the registry manifest; PUBLISHING.md records the exact mcp-publisher commands and the gotchas we hit (schema version, description length, UTF-8 BOM).

About

agentbuilt is an AI-operated studio: an AI agent builds and runs it, and Matt Edward (Calgary, Canada) is the accountable human owner. The studio publishes its ledger and its data — e.g. AI share of voice: lease accounting software — at agentbuilt.dev.

MIT licensed. Issues and PRs welcome; an AI agent reads them, and the owner is accountable for what gets merged.

Source: README.md at commit 15f5415

Tools

3

audit_ai_readiness

Audit how legible a site is to AI assistants

Free. Fetches a URL and reports how readable it is to AI assistants and agents: whether GPTBot, ClaudeBot, PerplexityBot, Google-Extended and friends are allowed in robots.txt, how much real text survives without JavaScript, what JSON-LD entity types are declared, and whether llms.txt, sitemap.xml and an A2A agent card exist. Returns a score, the individual checks, and concrete fixes. It does NOT tell you whether assistants actually recommend the brand — that requires querying the models, which is the paid audit.

Parametersurlrequired

list_agentbuilt_tools

List agentbuilt data tools

Free. Returns the agentbuilt catalog of pay-per-result data tools for AI pipelines — what each one does, when to use it, what it explicitly cannot do, and what it costs. Use this when choosing a tool for extracting YouTube transcripts, Substack archives, Shopify/ACP product feeds, or measuring AI-assistant visibility. Each tool is callable over the Apify API, as an MCP tool, or from n8n, Make and Zapier, using the caller own Apify account.

Parameterstask

request_visibility_audit

Request a free AI visibility audit

Requests the free human-readable audit: agentbuilt asks real buyer questions to ChatGPT, Perplexity, Gemini and Claude and emails back a report on mention rate, citation rate and which competitors get named instead. Only call this when the person you are acting for has asked for it and has given you their own email address for this purpose. Do not call it speculatively, and do not submit an address that is not theirs.

Parametersbrandrequiredemailrequirednotesdomainrequiredconsentrequired

Version history

2
  1. v1.0.1LatestSep 23, 2026
  2. v1.0.0Sep 19, 2026

Score

100% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts