搜尋引擎與 AI 爬蟲工具箱

dev.workers.panda198271.tw-search-seoPublished by tw-search-seo.panda198271.workers.devOfficial publisherv1.0.0Updated Oct 24, 2026

檢查網站爬蟲設定、驗證爬蟲 IP、IndexNow 提交與 YouTube SEO 檢查。

VerifiedStreamable HTTPWeb executableWeb Search & Scraping Developer Tools

Server details

Identifier: dev.workers.panda198271.tw-search-seo/search-seo
Transport: Streamable HTTP
Runtime: Web executable
Trust: Verified
Published: Sep 27, 2026

Security note

MCP servers receive tool arguments from a conversation and may perform external actions. Review what a server can do before you enable it, and give it only the access it needs.

The registry verified that this server's namespace belongs to tw-search-seo.panda198271.workers.dev, which also runs its endpoint. That identifies the publisher; it does not make the server's tools safe.

SourceWeft's checks cover whether the listing is complete and the endpoint answered; they do not review the server's code or what its tools do.

Add a badge to your README

Show readers this MCP server is listed on SourceWeft. The badge links to this page.

[![Listed on SourceWeft](https://sourceweft.com/badge/mcp/dev.workers.panda198271.tw-search-seo%2Fsearch-seo.svg)](https://sourceweft.com/mcp/dev.workers.panda198271.tw-search-seo%2Fsearch-seo?utm_source=readme&utm_medium=badge)

Overview

AI-generated overview

A remote toolbox that helps an assistant audit a site's crawler and SEO setup, generate search and meta markup, and submit URLs via IndexNow.

What you can do: It bundles 14 SEO and crawler tools. The assistant can build advanced search URLs for Google, Bing, Yahoo, Baidu and YouTube, compare search operator support, and generate or test robots.txt against RFC 9309. It can check a site's robots.txt, Sitemap and llms.txt for blocked search and AI crawlers, list crawler user agents, and verify whether an IP really belongs to Googlebot, GPTBot and similar bots. It also previews SERP titles and descriptions, generates meta tags and JSON-LD, checks YouTube chapter and tag limits, submits URLs through IndexNow, reports search engine market share, and scores a page's readiness for AI answer-engine citation.
When to use it: Useful when auditing or improving a website's search visibility and AI crawler accessibility, checking whether a bot is legitimately blocked or spoofed, or preparing pages for indexing and answer-engine citation. Also handy for drafting meta tags, robots.txt rules and YouTube metadata.
Requirements: A remote streamable HTTP endpoint; no package installation is needed. No authentication, environment variables or headers are declared. IndexNow submission requires a key file already hosted on the site. Some tools depend on external sources such as official crawler IP lists and StatCounter data, so network access is implied.

Before you install

indexnow_submit notifies search engines that URLs changed, which is an outward-facing action affecting live sites; it requires a key file on the site and accepts up to 100 URLs. verify_crawler_ip relies on official IP lists and reverse DNS lookups. Other tools only generate or check content, but review generated robots.txt and meta tags before deploying them.

Installation

In SourceWeft

Open 搜尋引擎與 AI 爬蟲工具箱 in the dashboard and add it to a workspace.
Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/dev.workers.panda198271.tw-search-seo%2Fsearch-seo/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "ai": {
      "type": "http",
      "url": "https://tw-search-seo.panda198271.workers.dev/mcp"
    }
  }
}

Tools

build_search_urls

一次產生 Google、Bing、Yahoo 奇摩、百度、YouTube 的進階搜尋網址（關鍵字、完全符合、排除字、限定網站、檔案類型、時間）。

Parametersqrequiredsitetimeexactexcludefiletype

search_operators

搜尋指令（site:、filetype:、intitle:、before: 等）在 Google、Bing、Yahoo、百度的支援對照與已失效指令。

Parametersengine

generate_robots_txt

產生 robots.txt：allow_all、block_training（封鎖 AI 訓練保留搜尋）、block_all_ai、block_all，可加不抓路徑與 Sitemap。

Parametersmodesitemapdisallow

test_robots_txt

依 RFC 9309 測試某個 User-Agent 能否抓取某路徑。

Parameterspathrobotsrequireduser_agentrequired

check_site_crawlers

檢查網站的 robots.txt、Sitemap、llms.txt，以及 Googlebot、bingbot、GPTBot、ClaudeBot、PerplexityBot 等是否被封鎖，附改善建議。

Parametersurlrequired

ai_crawler_list

AI 與搜尋引擎爬蟲 User-Agent 名單：業者、用途、是否遵守 robots.txt、官方 IP 清單。

Parameterstype

verify_crawler_ip

驗證 IP 是否真的來自 Googlebot、bingbot、GPTBot、ClaudeBot、PerplexityBot、Applebot、Baiduspider 等（官方 IP 清單＋反查 DNS）。

Parametersiprequiredbot

serp_preview

預覽 Google 搜尋結果標題與描述，估算中文像素寬度與截斷位置。

Parametersurltitlerequireddescription

generate_meta_tags

產生 title、description、canonical、Open Graph、Twitter 卡片與 JSON-LD。

Parametersurltypeimagetitlerequiredsite_namedescription

youtube_seo_check

檢查 YouTube 章節時間碼（0:00 起、至少 3 段、每段 10 秒）與標題、說明、標籤、主題標籤數量上限。

Parameterstagstitlechaptersdurationdescription

indexnow_submit

用 IndexNow 通知 Bing、Yandex、Naver 等搜尋引擎網址已更新（需先在網站放金鑰檔，最多 100 個網址）。

ParameterskeyrequiredhostrequiredurlsrequiredkeyLocation

search_submit_guide

如何讓 Google、Bing、Yahoo、百度、YouTube、AI 搜尋收錄網站：工具、步驟與 API。

Takes no parameters.

geo_citation_audit

AEO／GEO 引用準備度健檢：檢查網頁能否被 ChatGPT、Perplexity、Google AI 摘要等答案引擎引用（爬蟲可讀、開頭直接回答、問句標題、表格、外部與權威來源、更新日期、JSON-LD citation、llms.txt、Markdown 版、Content-Digest），給分數與優先修正清單。