Clearcrawl

io.github.clearcrawlPublished by GitHub account clearcrawlv0.4.2Updated Oct 27, 2026

Any URL to clean markdown/JSON; PDF, XLSX, CSV, DOCX to text and tables. Free tier for agents.

VerifiedStreamable HTTPWeb executableWeb Search & ScrapingFiles & Storage

Overview

AI-generated overview

Clearcrawl turns public URLs and PDF, XLSX, CSV or DOCX files into clean markdown, structured JSON, text and tables for an assistant.

What you can do
  • Fetch a public URL and get clean markdown plus structured JSON with title, author, date, links and tables, with ads, menus and footers stripped.
  • Convert PDF, XLSX/XLS, CSV or DOCX files supplied by URL or base64 into per-page text, sheet rows and records, and markdown tables.
  • PDF URLs are converted automatically when read as a page.
When to use it
Useful when an assistant needs readable page content or tabular data from web pages and office documents without writing its own scraping or parsing code, and when a small free daily quota is enough.
Requirements
Remote streamable HTTP endpoint, no install needed; a local stdio mode via npx also exists. No signup for the free tier of 100 calls a day. Paid credits need an Authorization header with a bearer API key, obtained after a Stripe checkout. Only public http(s) URLs, 15 MB max; first call after idle can take about a minute.
Before you install
Paid usage spends real money: read_url costs 2 credits and convert_file 3 credits per page or sheet, with credit packs starting at $5. The API key is a secret passed in the Authorization header or the CLEARCRAWL_API_KEY variable. Submitted URLs and files are sent to a third-party hosted service. No JavaScript rendering or OCR, so dynamic pages may come back incomplete.

Installation

In SourceWeft

  1. Open Clearcrawl in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.github.clearcrawl%2Fclearcrawl/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "clearcrawl": {
      "type": "http",
      "url": "https://agentreader.onrender.com/clearcrawl/mcp"
    }
  }
}

README

Clearcrawl MCP

An MCP server for Clearcrawl, a pay-per-call API built for AI agents:

  • read_url: turns any public URL into clean markdown or structured JSON (title, author, date, text, links, tables). Ads, menus and footers are stripped. PDF URLs are converted automatically.
  • convert_file: turns a PDF, XLSX/XLS/CSV or DOCX (by URL or local path) into text and tables (per-page text, sheet rows and records, markdown tables).

Free tier: 100 calls a day with no signup. Paid: 1 credit = $0.001; read_url costs 2 credits and convert_file costs 3 per page. Credit packs start at $5 for 5,000 credits.

Option 1: remote (no install)

Streamable HTTP endpoint: https://agentreader.onrender.com/clearcrawl/mcp

json
{ "mcpServers": { "clearcrawl": { "url": "https://agentreader.onrender.com/clearcrawl/mcp" } } }

Claude Code: claude mcp add --transport http clearcrawl https://agentreader.onrender.com/clearcrawl/mcp For paid credits, add the header Authorization: Bearer <your key>.

Option 2: local stdio

json
{ "mcpServers": { "clearcrawl": { "command": "npx", "args": ["-y", "github:clearcrawl/clearcrawl-mcp"], "env": { "CLEARCRAWL_API_KEY": "" } } } }

The local mode can also convert files from your disk (convert_file with path).

Getting an API key

POST https://agentreader.onrender.com/v1/credits/checkout {"pack":"ar_pack_5"} returns a Stripe Checkout URL. Once you pay, the success page shows your key. Full docs: https://agentreader.onrender.com/llms.txt

Notes

  • Clearcrawl runs on a free host, so the first call after it has been idle can take about a minute.
  • Limits: public http(s) URLs only, 15 MB max, no JavaScript rendering or OCR yet.

MIT licensed (this client). The Clearcrawl API itself is a hosted service.

More from our studio: VibePicks · LinkPreflight

Pairs well with LinkPreflight, our sister brand: preflight a URL with LinkPreflight, then extract it with Clearcrawl.

Source: README.md at commit ec3db43

Tools

2

read_url

Fetch a URL and return clean markdown plus structured JSON (title, author, links, tables). Cost: 2 credits ($0.002).

Parametersurlrequiredformat

convert_file

Convert a PDF, XLSX/CSV, or DOCX (by URL or base64) into text and tables. Cost: 3 credits ($0.003) per page/sheet.

Parametersurlbase64filename

Version history

1
  1. v0.4.2LatestOct 17, 2026

Score

100% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts