
Seo Crawler Mcp
io.github.houtini-ai由 GitHub 账号 houtini-ai 发布v2.0.1更新于 Oct 24, 2026
Crawl and analyse websites for SEO errors using Crawlee with SQLite storage
概览
已弃用的本地 MCP 服务器,将网站抓取到 SQLite,并让助手对抓取结果执行 SEO 分析查询。
- 可以做什么
- 抓取网站并将页面存入本地 SQLite 数据库
- 对抓取结果执行分析查询以发现 SEO 错误
- 基于已存储的抓取数据汇报问题
- 将抓取结果保存到指定的输出目录
- 适用场景
- 仅当你已在使用它,或需要一个简单的本地站点抓取加 SQLite 存储的 SEO 检查时。新用户被引导到后继项目 SEO Audit Console,它额外整合 Search Console 与 DataForSEO 数据。
- 运行要求
- 作为本地 stdio 进程运行,通过 npm 包 @houtini/seo-crawler-mcp 安装,需要 Node.js。必须设置环境变量 OUTPUT_DIR,指向保存抓取结果的目录;可将 DEBUG 设为 'true' 以输出详细日志。抓取目标站点需要网络访问。
安装
在 SourceWeft 中
- 打开 控制台中的 Seo Crawler Mcp,将其添加到工作区。
- 为需要使用其工具的对话启用该服务。
Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。
其他 MCP 客户端
参照 仓库 中的启动说明。
README
SEO Crawler MCP - retired
This project has been superseded by SEO Audit Console.
SEO Crawler crawled your whole site into SQLite and gave Claude 25+ analysis queries over the result. The crawler survived the move - it was rewritten to be stdio-safe and it is now the crawl half of a bigger tool.
SEO Audit Console keeps the crawl and adds the thing the crawl could never tell you on its own: what people actually searched for to get there. It merges the crawl with your Google Search Console history and on-demand DataForSEO data, then ranks every finding by the clicks it could recover rather than by severity.
A flat crawler sells you severity. This ranks by yield.
Where to go
Docs and setup: github.com/houtini-ai/seo-audit
What this means for you
- The npm package still installs.
@houtini/seo-crawler-mcpis deprecated, not unpublished. Nothing you have running will break. - This repository is archived. The code stays readable and every existing link keeps working, but there are no further releases, and issues and pull requests are closed.
- The crawler got better on the way over. It no longer depends on Crawlee (which logged to stdout and corrupted MCP's JSON-RPC framing), it seeds discovery from sitemaps and known GSC URLs rather than links alone, and it guards against redirects that wander off-host.
Migrating
Start a crawl on the new tool and it builds its own database:
Run refresh_property instead if you want the crawl, the Search Console sync and URL inspection in one pass.
Part of the Houtini open-source MCP set. Questions: [email protected].
来源:README.md,提交 cd222dc
工具
0版本历史
1- v2.0.1最新Sep 16, 2026
评分
已满足适用检查项的 50%
该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。
- 近 30 天内可连通25 分
请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。
- 已声明认证方式10 分
请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。
- 已列出工具15 分
请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。
- 描述必需15 分
- 图标10 分
- 文档15 分
- 许可证10 分