Robots Txt Checker

io.github.ryuamarinesv1.0.93057Updated Sep 23, 2026

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

VerifiedStreamable HTTPWeb executableBusiness & Commerce

Installation

In SourceWeft

  1. Open Robots Txt Checker in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "robots-txt-checker": {
      "type": "http",
      "url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
    }
  }
}

Tools

0
Tool metadata has not been indexed yet.

Version history

1
  1. v1.0.93057LatestSep 16, 2026