Robots Txt Ai Crawler Audit

io.github.jmshinhwav0.1.3Updated Sep 24, 2026

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI

VerifiedSTDIODesktop onlyAI & MLWeb Search & Scraping

Installation

In SourceWeft

  1. Open Robots Txt Ai Crawler Audit in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

Tools

0
Tool metadata has not been indexed yet.

Version history

2
  1. v0.1.3LatestSep 19, 2026
  2. v0.1.1Sep 16, 2026