Librecrawl — Technical SEO Audit MCP Server

io.github.adityaarsharma由 GitHub 帳號 adityaarsharma 發布v2.0.5更新於 Oct 24, 2026

Self-hosted technical SEO audit MCP. 50+ checks, WAF detection, ephemeral. Built on LibreCrawl.

發布方自己的服務:audit.domains - Domain Valuation

概覽

AI 產生的概覽

自架式 MCP 伺服器,可爬取網站並回傳依影響程度排序的技術 SEO 問題,每項附上淺顯的修正建議。

可以做什麼
  • 爬取網站並執行 30 多項技術 SEO 檢查,涵蓋失效連結、重新導向、canonical、標題與描述、標題層級、結構化資料、圖片、hreflang 與 sitemap 缺口
  • 偵測 WAF 挑戰並自動調整爬取延遲,以分塊爬取避免逾時
  • 依影響程度回傳問題清單,並為每項提供淺顯的修正說明
  • 在本地 reports 資料夾產生壓縮報告包,內含品牌化 PDF、Markdown 副本與 CSV
  • 提供 38 個 MCP 工具,用來驅動稽核與取得結果
適用情境
適合讓助理稽核自己負責的網站,並取得依優先順序排序的技術 SEO 待辦清單,同時不必註冊託管服務,也沒有頁數上限。
執行需求
在本地執行;引導式安裝需要 Docker,另有手動安裝方式。伺服器監聽本地 HTTP 端點,僅支援 stdio 的用戶端需透過 mcp-remote 連線。Google PageSpeed 金鑰為選用項目。需要連上伺服器的用戶端還需一個公開的 HTTPS 通道。
安裝前請注意
伺服器本身沒有登入機制,若透過通道對外暴露而未額外加上存取控制,任何人都能存取。爬蟲會向你稽核的網站送出請求,請僅用於你有權爬取的網站。報告會寫入本地 reports 資料夾。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Librecrawl — Technical SEO Audit MCP Server,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

[Sitewalk logo]

Sitewalk: SEO audit in ChatGPT, and the open-source technical SEO audit server

Ask ChatGPT to audit your website. Find what is broken, what to fix first, and how, in about a minute of your time.

[Use Sitewalk in ChatGPT] [Self-host with Docker] [Website]

[ChatGPT or self-host?] [What is MCP?] [MIT licence] [Latest release] [Powered by LibreCrawl]


Sitewalk crawls your site the way a search engine bot does and gives you the technical SEO problems ranked by impact, each with a plain fix, a site health score out of 100, and a report you can send to a client or developer.

Two ways to use it

In ChatGPT (hosted)Self-hosted (this repository)
SetupNone. Open the app, ask for an auditDocker, one command: ./setup.sh
Checks200+ in 18 groups30+
CostFree to start, 5 audits a monthFree forever, MIT licence
Pages per audit50 without a confirmed email, 500 with oneNo cap, your machine
Your dataReport links, CSV and PDFNever leaves your machine
Best forSite owners, freelancers, agenciesDevelopers who want to run it themselves

Start in ChatGPT: Use Sitewalk in ChatGPT. This repository is the open-source server and nothing else: a Python MCP server that drives the open-source LibreCrawl crawler. The hosted service runs separate code.

Try it in 60 seconds

  1. Open Sitewalk in ChatGPT.
  2. Type: Audit https://yoursite.com for technical SEO problems
  3. The first time, enter the 6-digit code we email you. No password.

Other things people ask it:

  • What should I fix first on my site?
  • Find broken links, redirect chains and duplicate titles
  • Is a noindex tag or robots.txt keeping my pages out of search?
  • Is my site ready for AI search? Check llms.txt and AI crawler access
  • Monitor yoursite.com and tell me if something breaks

What you get

  • A site health score out of 100 and every problem ranked worst first, with the pages it affects.
  • A plain-English fix for each problem, so you can act on it or hand it to a developer.
  • A web report, plus PDF and CSV downloads.
  • Checks for broken links and redirect chains, titles and meta descriptions, canonicals and noindex, hreflang, sitemaps, structured data, images, security headers, page speed and AI-search readiness.
  • Monthly monitoring of a site you have audited, with an email only when something changes.
  • Politeness built in: it reads robots.txt, identifies itself as SitewalkBot, and keeps a slow pace.

Not covered: backlinks, keyword rankings, Google Search Console or analytics data.

Common questions

Is there a Screaming Frog alternative that works inside ChatGPT? Sitewalk runs the crawl on its own server and returns a ranked list in the chat, so there is nothing to install. Screaming Frog is stronger for very large sites and custom extraction: see the comparison, with dated sources.

Is there a free technical SEO audit tool? Yes. Sitewalk is free for 5 audits a month in ChatGPT, and the self-hosted server is free with no limits.

Does it work on any website? Any public website, within robots.txt. A site that blocks crawlers will say so in the report.

How long does an audit take? A small site usually takes a few minutes, a 500-page audit 20 to 60 minutes. It keeps running if you close the chat, and you get an email when it is done.

A free, open-source Screaming Frog alternative

The self-hosted build in this repository is free and MIT licensed, with no page cap and no account. You run it with Docker, ask your AI assistant to audit a site, and get a ranked list of technical SEO problems, a PDF and CSVs, with your data staying on your machine. It runs 30+ checks: broken links, redirects, canonicals, titles and descriptions, headings, schema, images, hreflang and sitemap gaps.

Screaming Frog is stronger for very large crawls, custom extraction and JavaScript rendering of a whole site. If you want the result inside ChatGPT without hosting anything, use the hosted app (200+ checks, 5 free audits a month). Dated comparison: Sitewalk vs Screaming Frog.

What is MCP?

MCP (Model Context Protocol) is an open standard that lets an AI assistant call outside tools. This repository is one such tool: your assistant asks it to crawl a site and gets the findings back. You do not need to know anything about MCP to use Sitewalk in ChatGPT. It only matters if you run this repository yourself.

Self-host it

You need Docker running. Then:

bash
git clone https://github.com/adityaarsharma/sitewalk.gitcd sitewalk./setup.sh

The script checks your machine, asks one optional question (a Google PageSpeed key), builds and starts the stack, waits until the MCP server answers, and prints exactly how to connect your assistant. The first build takes a few minutes.

CommandWhat it does
./setup.shGuided setup
./setup.sh --yesSame, no questions
./setup.sh --checkOnly check that your machine can run it
./setup.sh --updatePull the newest release and rebuild
./setup.sh --stopStop it (your reports are kept)

Without Docker, see the manual route in docs/GETTING-STARTED.md.

Connect an assistant

The server listens on http://127.0.0.1:5081/mcp (streamable HTTP).

  • ChatGPT and Grok reach servers over the internet, so they need a public https address that forwards to your machine. The server has no sign-in of its own, so put it behind a tunnel that adds access control. Steps in docs/GETTING-STARTED.md.
  • Clients on your computer (Codex, Windsurf, any stdio-only client) connect through mcp-remote:
json
{  "mcpServers": {    "sitewalk": {      "command": "npx",      "args": ["-y", "mcp-remote", "http://127.0.0.1:5081/mcp"]    }  }}

Then ask: Audit https://yoursite.com for technical SEO problems.

Self-hosted details

  • 30+ checks per audit (self-hosted) (broken links, redirects, canonicals, titles and descriptions, headings, schema, images, hreflang, sitemap gaps, and more). Full list and the nine report files: docs/CHECKS.md.
  • A branded PDF, a Markdown copy and CSVs, zipped in ./reports.
  • Chunked crawling that does not time out, WAF challenge detection, and a crawl delay that adapts to the site.
  • 38 MCP tools: docs/TOOLS.md.

Docs

GuideWhat is inside
Getting startedDocker and manual setup, connecting clients, your first audit
ConfigurationEvery environment variable, HTTP and stdio transport
ToolsAll 38 MCP tools
ChecksThe 30+ checks and the report files
ArchitectureHow the pieces fit
TroubleshootingCommon errors and fixes

Releases

Every change to the code that lands on main is tested and published as a new GitHub release automatically. Update with ./setup.sh --update.

Licence and credits

Code is MIT: see LICENSE and NOTICE.md. Built on LibreCrawl (MIT), FastMCP and WeasyPrint. No telemetry.

Built by Aditya Sharma.

來源:README.md,提交 42e1b87

工具

0
SourceWeft 尚未在沙箱中啟動過該軟體包,因此其工具未知。

版本歷史

1
  1. v2.0.5最新Sep 16, 2026

評分

已滿足適用檢查項的 50%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分

    請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。

  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。

  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分

其他 Audit 整合