Web Hygiene MCP

io.github.Luca-003Published by GitHub account Luca-003v0.2.1Updated Oct 24, 2026

Live web checks for AI agents: sitemaps, robots.txt, URL status, broken links, feeds, citations.

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingDeveloper Tools

Overview

AI-generated overview

A remote MCP server that lets an assistant check the live web: sitemaps, robots.txt, URL status, broken links, feeds and cited sources.

What you can do
Inspect a site's robots.txt, llms.txt, sitemaps and feeds, and list the URLs its sitemaps publish with lastmod dates, filtered by regex and capped at 2,000 URLs. Check a single URL's HTTP status, redirect chain, final URL, response time and content type. Bulk-check up to 300 links for 404s, 5xx errors, timeouts, SSL errors, redirect chains and slow pages. Discover and read RSS, Atom and JSON feeds with normalised items, dates in UTC, authors and enclosures. Verify citations: per cited URL, report verified, mismatch, not-found, redirected-home, paywalled or blocked, with real title, date, author and quote-match evidence, plus Internet Archive copies for dead links.
When to use it
Use it when an assistant needs to confirm that links and sources actually exist before citing them, to check what a site allows and publishes before quoting it, or to audit broken and redirected links in a document or site.
Requirements
A remote Streamable HTTP endpoint; no local runtime or package. Requires an Apify API token sent as a Bearer token in the Authorization header. An Apify account is needed, and network access to the endpoint.
Before you install
The Authorization header carries an Apify API token, which is a secret. Tool calls are billed pay-per-event to the Apify account, so usage costs money; a free account includes limited monthly credits. The tools fetch public pages and files you name from third-party sites.

Installation

In SourceWeft

  1. Open Web Hygiene MCP in the dashboard and add it to a workspace.
  2. Connect Authorization token credentials. They are stored privately and never shown on public pages.
  3. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.github.Luca-003%2Fweb-hygiene-mcp/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "web-hygiene": {
      "type": "http",
      "url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",
      "headers": {
        "Authorization": "Bearer <YOUR_TOKEN>"
      }
    }
  }
}

README

Web Hygiene MCP

[AllMCPs Verified] · Official MCP Registry: io.github.Luca-003/web-hygiene-mcp

Remote MCP server (Streamable HTTP) that gives AI agents seven tools answering from the live web — never from a cache or the model's memory:

ToolWhat it does
site_overview(site)robots.txt (sitemaps declared, AI crawlers addressed, blanket disallow), llms.txt, sitemaps with URL count sample, feeds
list_site_urls(site_or_sitemap, max_urls, include_regex, exclude_regex)URLs a site publishes in its sitemaps, with lastmod (≤ 2,000)
check_url(url)HTTP status, full redirect chain, final URL, response time, content type
check_links(urls | site_or_sitemap, max_urls, problems_only)Bulk check: 404s, 5xx, timeouts, SSL errors, redirect chains, slow pages (≤ 300)
discover_feeds(site)RSS / Atom / JSON feeds of a website
read_feed(feed_or_site, max_items, include_content)Normalised feed items: title, link, date in UTC, author, summary, enclosures (≤ 100)
verify_citations(text | urls | citations, check_archive, max_citations)Per cited URL: verified / mismatch / not-found / redirected-home / paywalled / blocked …, real title/date/author, quote match evidence, Internet Archive copy for dead links (≤ 50)

Connect

URL:    https://bruco3--web-hygiene-mcp.apify.actor/mcpHeader: Authorization: Bearer <YOUR_APIFY_API_TOKEN>

Claude Desktop / Cursor / any Streamable HTTP client:

json
{  "mcpServers": {    "web-hygiene": {      "url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",      "headers": { "Authorization": "Bearer YOUR_APIFY_API_TOKEN" }    }  }}

A free Apify account gives you an API token and $5 of monthly credits. Tool calls are billed pay-per-event to your Apify account: a check_url costs a fraction of a cent; verifying the 10 sources of an answer about two cents. No subscription, nothing to run.

Try it — three prompts

  1. "Check the sources in the answer you just gave me: does each link exist, and is the quote really on the page?" → verify_citations
  2. "Before we cite anything from example.com, what does the site publish and allow?" → site_overview
  3. "Check every link in this README and tell me which are broken or redirected." → check_links

Claude Code: ready-made plugin with two skills — /plugin marketplace add Luca-003/web-hygiene-claude-plugin then /plugin install web-hygiene@luca-003 (repo).

Why

Language models are confident about links and sources they have never fetched. These tools let an agent look before it claims: verify a URL exists and where it leads, check robots.txt and llms.txt before quoting a site, read what a site really publishes, confirm a cited page carries the quoted passage.

Details, pricing, issues

Full documentation, pricing table and issue tracker: https://apify.com/bruco3/web-hygiene-mcp

Related Actors for whole-site / whole-document jobs: Sitemap URL Extractor · Broken Link Checker · Feed Monitor · Citation & Link Verifier

Legal

The tools request only public files sites publish for automated readers (sitemaps, feeds, robots.txt, llms.txt) and public pages you name, with a clear User-Agent. No personal data is collected or stored.

This repository holds the registry metadata (server.json) and documentation; the server runs on Apify.

Source: README.md at commit 75d0ca1

Tools

0
This server asks for a credential such as an API key, so SourceWeft could not read its tools without one and has not indexed them.

Version history

1
  1. v0.2.1LatestSep 21, 2026

Score

75% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts

    Declare a license in the repository or the registry entry.