Robotstxt Ai

io.github.sharozdawav1.0.1Updated Sep 23, 2026

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

VerifiedSTDIODesktop onlyWeb Search & ScrapingAI & ML

Installation

In SourceWeft

  1. Open Robotstxt Ai in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

Tools

0
Tool metadata has not been indexed yet.

Version history

1
  1. v1.0.1LatestSep 16, 2026