llms.txt 檢查工具

dev.workers.panda198271.llms-checkPublished by llms-check.panda198271.workers.devOfficial publisherv1.0.0Updated Oct 25, 2026

檢查網站 llms.txt 與 AI 爬蟲 robots.txt 設定，並自動產生 llms.txt。

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingDeveloper Tools

Overview

AI-generated overview

Checks how AI-friendly a website is: llms.txt presence and format, AI crawler rules in robots.txt, and draft llms.txt generation.

What you can do
Audit a site's AI readiness with a 0–100 score and improvement suggestions covering llms.txt, llms-full.txt, Markdown pages, robots.txt and sitemap. Read robots.txt and report whether 13 AI crawlers such as GPTBot, ClaudeBot and PerplexityBot are allowed or blocked. Generate a draft llms.txt from a site's homepage and sitemap. Validate a given llms.txt text against format rules for headings, summary, sections and links.
When to use it
Useful when preparing a site for AI crawlers and assistants, auditing existing llms.txt or robots.txt settings, or drafting and checking an llms.txt file before publishing it.
Requirements
A remote streamable HTTP endpoint; no authentication, environment variables or headers are declared. The target sites must be reachable over the network.
Before you install
The server fetches the target website's homepage, robots.txt and sitemap, so those URLs are sent to a third-party service. Generated llms.txt output is a draft and should be reviewed before publishing.

Installation

In SourceWeft

  1. Open llms.txt 檢查工具 in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/dev.workers.panda198271.llms-check%2Fllms-check/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "llms-txt": {
      "type": "http",
      "url": "https://llms-check.panda198271.workers.dev/mcp"
    }
  }
}

Tools

4

check_llms_txt

檢查一個網站對 AI 的友善程度：llms.txt 是否存在與格式問題、llms-full.txt、Markdown 頁面、robots.txt 對各 AI 爬蟲的設定、sitemap，回傳 0–100 分與改善建議。

Parametersurlrequired

check_ai_crawler_access

讀取網站 robots.txt，回報 GPTBot、ChatGPT-User、ClaudeBot、Claude-User、PerplexityBot 等 13 種 AI 爬蟲是被允許還是封鎖。

Parametersurlrequired

generate_llms_txt

讀取網站首頁與 sitemap，自動產生 llms.txt 草稿。

Parametersurlrequired

validate_llms_txt

驗證一段 llms.txt 內容是否符合格式（H1、摘要、分區、連結）。

Parameterscontentrequired

Version history

1
  1. v1.0.0LatestSep 27, 2026

Score

83% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.