citable

io.github.genzagentsPublished by GitHub account genzagentsv0.4.2Updated Oct 29, 2026

Can ChatGPT, Claude and Perplexity read and cite your site? robots.txt, edge blocks, llms.txt.

VerifiedSTDIODesktop onlyWeb Search & ScrapingDeveloper Tools

Overview

AI-generated overview

Checks whether AI answer engines can read and cite a website, scoring robots.txt, edge blocks, llms.txt and page markup, and drafts a starter llms.txt.

What you can do
  • Check a site's AI citability: fetch the homepage as each answer bot and score robots.txt, edge/WAF blocks, llms.txt, JS-free content, JSON-LD, title and description, HTTPS, canonical and sitemap out of 100, with a fix per failure.
  • Draft a starter llms.txt built from a site's homepage.
  • Report training-crawler rules as information only, without penalising them.
When to use it
Useful when you want an assistant to audit a site's AI visibility, diagnose why ChatGPT, Claude or Perplexity do not cite it, or generate a first llms.txt while working in an MCP client.
Requirements
Runs locally over stdio as a Python 3.9+ process with no dependencies, installed from the citable-cli PyPI package (for example via uvx) or run from a single file. No accounts, keys or environment variables are declared for the MCP server; network access is needed to fetch the target site.
Before you install
The check fetches the target site's homepage repeatedly, impersonating named AI bot user agents, which may hit rate limiters or WAF rules. The edge check compares HTTP status only, so a 200 challenge page can pass. The README's watch, track and hosted features are separate CLI or paid offerings that use API keys or GitHub tokens and post public issues; they are not part of the two MCP tools.

Installation

In SourceWeft

  1. Open citable in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

README

citable

[GitHub Marketplace] [PyPI]

Can ChatGPT, Claude and Perplexity actually read and cite your site?

Most "AI visibility" checkers read robots.txt and stop. citable fetches your homepage as each AI bot and reports the blocks that robots.txt never mentions (Cloudflare "Block AI bots", WAF rules, rate limiters), then checks the rest of the list: llms.txt, JSON-LD, title and description, JS-only content, sitemap, canonical. Score out of 100, every failure with the fix. Also runs as an MCP server so your agent can check sites for you.

Zero dependencies. One file. Python 3.9+.

bash
pipx install citable-cli     # from PyPI; on a Mac: brew install pipx first. Or: uvx --from citable-cli citablecitable example.com                # reportcitable example.com --json         # for scripts and CI (exit 1 if below --min-score=N)citable example.com --llms-txt     # a starter llms.txt built from your homepagecitable watch a.com b.com          # weekly watch: GitHub issue per site, comment (email) on regressionscitable track a.com "best X" "how Y"  # prompt tracking: which engines cite you, who gets cited instead

No install at all:

bash
curl -sL https://raw.githubusercontent.com/genzagents/citable/main/citable/__init__.py | python3 - example.com

What a run looks like

citable 0.3.0: https://reddit.com/  score 13/100  grade F   (final URL https://www.reddit.com/)
  [FAIL]  0/15 robots.txt allows answer engines: robots.txt blocks: OAI-SearchBot, ChatGPT-User, Claude-SearchBot, ...  [FAIL]  0/20 Answer engines not blocked at the edge: Fetching the homepage as a bot: ChatGPT-User got HTTP 403; a browser got 200.         fix: Your CDN or WAF (Cloudflare 'Block AI bots', bot-fight mode, a rate limiter) is refusing them ...  [FAIL]  0/15 /llms.txt: /llms.txt returns HTTP 404.  ...  Bot                 Vendor                 Role    robots.txt   live fetch  OAI-SearchBot       OpenAI                 answer  block        HTTP 200  ChatGPT-User        OpenAI                 answer  block        HTTP 403  <- BLOCKED  Claude-SearchBot    Anthropic              answer  block        HTTP 200  ...

What it checks

CheckPointsWhy it matters
robots.txt allows the answer bots (OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, DuckAssistBot, Bingbot, Googlebot)15These fetch pages to answer live questions and cite the source. Blocked means never cited.
Not blocked at the edge: homepage fetched as each of those bots returns what a browser gets20CDN and WAF "block AI" toggles stop bots that robots.txt allows. Nothing else on this list matters until this passes.
Training crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, Applebot-Extended, meta-externalagent, Amazonbot, Bytespider)infoBlocking them is a legitimate choice and does not affect citations. Reported, never penalised.
/llms.txt present, plain text, with an H1, a > summary and links15The convention answer engines and agents read first. A soft-404 HTML page counts as missing.
Content readable without JavaScript (words in the raw HTML)15Most AI crawlers do not run JS. A client-rendered shell is invisible to them.
JSON-LD structured data (Organization, WebSite, Article, FAQPage...)10Entities and FAQs get quoted directly.
Title and meta description, sensible lengths8Quoted verbatim in answers.
HTTPS, response time, canonical, Open Graph, sitemap, <html lang>, no noindex22Hygiene that decides which URL gets the citation.

As an MCP server (Claude Code, Claude Desktop, Cursor, any MCP client)

Tools: check_site(url, live=true) and draft_llms_txt(url).

Claude Code plugin (includes the MCP server and a skill that knows how to act on the report):

bash
claude plugin marketplace add genzagents/marketplaceclaude plugin install citable@genzagents

Any MCP client, by hand:

json
{ "mcpServers": { "citable": { "command": "python3", "args": ["/path/to/citable/citable/__init__.py", "mcp"] } } }

The server speaks MCP over stdio with no dependencies, so it runs anywhere Python does.

In CI

Fail the build when a deploy breaks AI access (a new WAF rule, a lost llms.txt, a Disallow: / that slipped in):

bash
citable yoursite.com --min-score=70 --json > citable.json

Watch

A deploy that flips a WAF toggle silently removes you from every AI answer. The watch is the alarm. It runs as a GitHub Action in any repo you own (it need not be the site's repo), keeps one issue per site up to date, and comments on that issue the moment an answer bot is blocked, llms.txt disappears, the site goes down or the score drops, which GitHub emails to you. No server, no account, no dependencies. Example: issue #1 watches this project's own page.

Copy docs/watch.yml to .github/workflows/citable-watch.yml:

yaml
on:  schedule: [{ cron: "17 6 * * 1" }]   # Mondays  workflow_dispatch:permissions: { issues: write, contents: read }jobs:  watch:    runs-on: ubuntu-latest    steps:      - uses: genzagents/[email protected]        with:          sites: |            example.com            docs.example.com          # min-score: 75

Inputs: sites (required), min-score (fail below it), live (fetch as each bot, default true), issue (track in an issue, default true), notify (login to @mention on a regression, default repo owner), fail-on-regression (default true). Outputs: score, regressed, changed. Same thing from a shell where gh is logged in:

bash
citable watch example.com docs.example.com --repo=you/your-repo --notify=you

Hosted, $12/month (about £9): the same watch run by us, no repo needed, up to 5 domains, with a weekly digest. Live now through GitHub Sponsors:

  1. Sponsor genzagents at $12 a month →
  2. Open your Hosted watch issue → from the same account. Reports are posted on it (the issue is public).

Track

The watch tells you whether engines can read you. Track tells you whether they do: for the questions you want to be the answer to, does ChatGPT, Claude or Perplexity link to your site, and who gets linked instead?

bash
citable track example.com "best tools for X" "how do I Y" --brand=Example
## citable track: example.com
**Visibility 50%**: share of prompt-and-engine pairs where an answer linked to your site.
| Prompt | anthropic | openai | perplexity ||---|---|---|---|| best tools for X | **cited** | mentioned | **cited** || how do I Y | no | no | no |
**Who gets cited instead** (answers citing them): rival.io (4), other.org (2)

Engines: anthropic (ANTHROPIC_API_KEY, the web_search tool), openai (OPENAI_API_KEY, Responses API web search), perplexity (PERPLEXITY_API_KEY, sonar) and claude-code (the claude CLI on your machine, no key). Every engine whose key is present runs; --engines= picks a subset. Add --issue --repo=you/repo (or run it from the Action with a prompts: input) and it keeps a "citable track: example.com" issue up to date and comments when a citation is lost, which is the weekly email the paid tools charge $29 to $39 a month for. Bring your own keys; a 10-prompt run on three engines costs a few cents.

Hosted ($12/month, about £9)

No repo, no keys, no cron: sponsor genzagents at $12 a month, open a Hosted watch issue with your sites (up to 5), the prompts that matter (up to 10) and your brand, and the first report is posted on the issue within the hour. After that you get a comment the moment something regresses and a digest once a week with the prompt tracking (GitHub emails you each one). Cancel from your GitHub sponsorships page.

citable hosted run --source=github matches active sponsors to the open hosted issues they authored and comments the reports there, so it needs only a GitHub token. The Polar + Resend mode below is for private email delivery.

The runner is in this repo (citable hosted), so you can also run the same thing yourself for your own customers: it polls Polar for active subscriptions, keeps one small state file per subscriber, and sends through Resend. Zero dependencies, one hourly cron. See docs/HOSTED.md.

bash
citable hosted run --dry-run                  # against Polar, prints the emails instead of sendingcitable hosted run --subscribers=subs.json    # against a local list (no Polar), e.g. for your own clientscitable hosted launchd                        # a launchd plist that runs it hourly on a Mac

Notes

  • MCP registry name: mcp-name: io.github.genzagents/citable (PyPI package citable-cli; the import and the command stay citable).

  • Bot user agents and roles follow the vendors' published strings (OpenAI, Anthropic, Perplexity). Role "answer" = fetches to answer or cite in a live conversation; "train" = builds training corpora.

  • The edge check compares HTTP status only. A site that returns 200 with a challenge page to bots will pass; file an issue with the domain and it gets a heuristic.

  • --no-live skips the bot fetches (faster, robots.txt only).

Development

bash
python3 -m unittest discover -s tests -v

MIT. Built by genzagents.

Source: README.md at commit 3d8d974

Tools

0
SourceWeft has not started this package in its sandbox yet, so its tools are not known.

Version history

1
  1. v0.4.2LatestOct 29, 2026

Score

50% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 days25 pts

    Keep the endpoint answering the MCP handshake; SourceWeft probes it every 30 days.

  • Auth declared10 pts

    Declare the credential headers in the registry entry, or keep the endpoint answering the probe so its auth can be classified.

  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts