Remote MCP server that scores a public website's readiness for AI search and checks whether robots.txt lets AI crawlers in.
What you can do
Scan a public site and get an AI-readiness score from 0 to 100 with sub-scores and a list of issues with concrete fixes
Check whether robots.txt allows or blocks AI crawlers such as GPTBot, PerplexityBot, ClaudeBot, Google-Extended and Applebot-Extended, optionally for a single bot
Report on signals such as structured data, llms.txt, sitemap and page structure
When to use it
Useful when someone asks whether a site is visible or optimized for ChatGPT, Perplexity, Claude, Gemini or AI search, or wants a quick technical audit of AI crawler access before publishing or after a redesign.
Requirements
Remote streamable HTTP endpoint; no package, account, API key or environment variable is declared. The site being checked must be publicly reachable.
Before you install
Results are technical-readiness signals, not ranking or citation guarantees. Only robots.txt is checked, so a firewall may still block a bot. The scanned site URL is sent to the provider's service.
Enable the server for the chats that should use its tools.
Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.
Use with an agent
Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.
Read https://sourceweft.com/mcp/com.aiocompatible%2Fai-readiness/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.
Scan a public website and return an AI-readiness score (0-100), sub-scores, AI-bot robots.txt access, and a list of issues with concrete fixes. Use when a user asks if a site is visible/optimized for ChatGPT, Perplexity, Claude, Gemini or AI search.
Parametersurlrequiredcategory
check_bot_access
Check if an AI bot is blocked by robots.txt
Check whether a site's robots.txt allows or blocks AI crawlers (GPTBot, PerplexityBot, ClaudeBot, Google-Extended, Applebot-Extended). Optionally limit the answer to one bot. Note: only robots.txt is checked; a firewall may still block a bot.
Parametersboturlrequired
Version history
1
v1.0.0LatestNov 14, 2026
Score
83%
83% of the applicable checks met
How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.
Reached in the last 30 daysRequired25 pts
Auth declaredRequired10 pts
Tools listedRequired15 pts
DescriptionRequired15 pts
Logo10 pts
Documentation15 pts
Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.
LicenseNot applicable
A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.
More servers like AICompatible AI-readiness checker