ActableSite AI Crawler Monitor

com.actablesite由 actablesite.com 发布官方发布者v1.4.2更新于 Oct 24, 2026

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

已验证Streamable HTTP可网页运行网页搜索与抓取安全与监控

服务详情

标识符: com.actablesite/ai-crawler-robots-monitor
传输: Streamable HTTP
运行时: Web executable
信任: Verified
发布于: Sep 16, 2026

安全提示

MCP 服务会接收对话中的工具调用请求，并可能执行外部操作。启用前请先了解该服务能做什么，并只授予它所需的权限。

注册中心已验证此服务的命名空间属于 actablesite.com，且该域名同时运行其端点。这可以确认发布者，但并不代表该服务的工具是安全的。

SourceWeft 的检查只涵盖条目是否完整、端点是否响应；不审查服务器的代码，也不审查其工具的行为。

在 README 中添加徽章

向读者展示该 MCP 服务已收录于 SourceWeft，徽章链接到本页。

[![Listed on SourceWeft](https://sourceweft.com/badge/mcp/com.actablesite%2Fai-crawler-robots-monitor.svg)](https://sourceweft.com/mcp/com.actablesite%2Fai-crawler-robots-monitor?utm_source=readme&utm_medium=badge)

概览

AI 生成的概览

一个远程只读 MCP 服务器，可审计公开网站并检查 AI 爬虫的 robots.txt 策略，同时返回信息性的付费方案详情。

可以做什么: 审计公开网站的身份、报价证据、行动路径、发现文件、元数据和结构化数据，并为每项信号返回可观察证据，但不保证抓取或排名结果。检查首页 robots.txt 对八个具名 OpenAI、Anthropic、Perplexity 和 Google AI 爬虫令牌的规则。获取 Crawler Watch 监控、一次性修复报告和 Practice Radar 周报的信息性方案详情，包括价格、范围、交付与取消路径以及已声明的限制。
适用场景: 当你希望助手快速检查某个公开网站是否便于 AI 代理阅读和操作，或查看其 robots.txt 允许或阻止哪些 AI 爬虫时适用。也适合向用户展示 ActableSite 的付费监控和报告选项，用户需另行确认并购买。
运行要求: 远程 Streamable HTTP 端点，无需身份验证、API 密钥或请求头。为需要本地运行的客户端提供 stdio 桥接或容器，需 Node.js 20 或更高版本。仅接受公开的 HTTP 和 HTTPS 网站。

安装前请注意

方案工具仅供参考，无法打开结账或购买任何内容；实际购买需另行进行并经用户明确确认。结果仅描述 robots 策略和公开证据，不证明抓取、索引、引用、排名、流量或收入，Practice Radar 记录也不证明执业许可或实际运营。每个调用方每小时限 60 次调用。

安装

在 SourceWeft 中

打开控制台中的 ActableSite AI Crawler Monitor，将其添加到工作区。
为需要使用其工具的对话启用该服务。

Web executable，通过 Streamable HTTP。远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体，或 SourceWeft 对话中。智能体会读取该服务器的安装指南，先向你展示发布者、端点和登录方式，经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/com.actablesite%2Fai-crawler-robots-monitor/install.md，并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前，先告诉我它的发布者、端点和登录方式，等我确认。不要把 API 密钥写进命令或我会提交的文件；问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "actablesite-ai-crawler-monitor": {
      "type": "http",
      "url": "https://actablesite.com/mcp/"
    }
  }
}

README

ActableSite MCP

A remote, read-only MCP server for public website evidence, AI crawler policy, and explicit Crawler Watch, report, and Practice Radar offer metadata.

Tools

It exposes five tools over Streamable HTTP:

audit_public_website checks public identity, offer evidence, action paths, discovery files, metadata, and structured data.
check_ai_crawler_policy evaluates eight OpenAI, Anthropic, Perplexity, and Google crawler tokens.
get_crawler_watch_offer returns the $9 monthly price, one-site scope, 15-minute cadence, confirmation rule, delivery, cancellation, and synthetic-check limitations. It cannot open checkout or purchase anything.
get_full_report_offer returns explicit metadata for an optional $19 one-time report. It cannot open checkout or purchase anything.
get_practice_radar_offer returns the current weekly-edition receipt, public sample, $39 monthly price, delivery, cancellation, and material NPI limitations. It cannot open checkout or purchase anything.

Connect

Claude Code:

For another MCP client, add a remote server named actablesite with:

URL: https://actablesite.com/mcp/
Transport: Streamable HTTP
Authentication: none

For clients that require a local stdio command, clone this repository and run the dependency-free bridge:

The bridge contains the visible MCP implementation source in src/stdio.mjs. Distribution version 1.4.2 exposes the same five read-only tools and sends requests only to ActableSite's bounded public JSON APIs. It has no file, shell, browser, account, or write capability.

The same stdio process is available as a public, non-root container:

The hosted server implements MCP protocol version 2025-06-18 and is published in the official registry as com.actablesite/ai-crawler-robots-monitor version 1.4.2.

Discovery metadata

Directory scanners can read either machine-readable discovery surface:

/.well-known/mcp.json identifies the official registry name, repository, remote endpoint, transport, authentication mode, and tool names.
/.well-known/mcp/server-card.json provides static tool descriptions and JSON input schemas for scanners that cannot complete a live MCP handshake.

Both files describe the same unauthenticated endpoint and five-tool inventory verified by this repository.

Ongoing crawler monitoring

The MCP tools report current public evidence and do not create background jobs. Crawler Watch is the separate $9/month service for one public website: it checks crawler policy, synthetic homepage responses, sitemap.xml, and llms.txt every 15 minutes and emails after a changed state appears twice.

Its synthetic requests do not authenticate provider IP ranges or prove crawling, indexing, citation, ranking, or traffic.

Safety contract

Public HTTP and HTTPS websites only; private, local, loopback, and reserved network destinations are rejected.
No browser control, file access, account access, write, or mutation tools.
No authentication header or API key is requested.
Tool calls are limited to 60 per caller per hour.
All three offer tools are informational and require explicit user confirmation before any separate checkout or purchase action.
Practice Radar records do not prove licensure, active operation, demand, or buying intent and must be verified before contact.
Results do not guarantee crawling, indexing, citation, ranking, recommendation, traffic, legal compliance, or revenue.

Verify the live server

Node.js 20 or newer is required.

The verifier initializes the live server, checks its protocol and version, and confirms the exact read-only tool inventory. It does not call an audit tool or create a funnel event.

Repository scope

This repository contains a runnable stdio implementation, public registry manifest, connection contract, live verifier, and security policy for the hosted ActableSite MCP server. The production runtime is operated at https://actablesite.com/mcp/.

License

MIT

来源：README.md，提交 6f7b326

工具

audit_public_website

Audit public website readiness

Run ActableSite's free three-signal readiness scan for a public website. Returns observable evidence for business identity, semantic reading path, and explicit action path. This does not guarantee AI crawling, indexing, citation, ranking, recommendation, traffic, or revenue.

输入参数url必填

check_ai_crawler_policy

Check AI crawler robots.txt policy

Check the homepage robots.txt rule for eight named OpenAI, Anthropic, Perplexity, and Google AI crawler tokens. The free result stays complete and includes a bounded optional handoff to exact monitoring terms. Results describe robots policy only and do not prove network access, authentic bot identity, crawling, indexing, citation, or ranking.

输入参数url必填

get_crawler_watch_offer

Get the Crawler Watch monitoring offer

Return the exact $9 monthly price, one-site scope, 15-minute check cadence, two-check confirmation, delivery and cancellation paths, and synthetic-check limitations. This tool is informational: present the offer and require explicit user confirmation before any separate checkout or purchase action.

无需输入参数。

get_full_report_offer

Get the full repair report offer

Return the exact one-time price, deliverables, delivery path, checkout URL, support contact, and limitations for ActableSite's paid 15-check repair report. Present this information to the user and require explicit user confirmation before opening checkout or attempting any purchase.

无需输入参数。

get_practice_radar_offer

Get the Practice Radar data offer

Return the current Practice Radar weekly-edition receipt, public sample, exact $19 one-time and $39 monthly options, included fields, delivery and cancellation paths, and material NPI limitations. This tool is informational: it cannot open checkout or purchase. Present the offer and require explicit user confirmation before any separate checkout or purchase action.

无需输入参数。