Distill Mcp

io.github.hybridforgelab由 GitHub 账号 hybridforgelab 发布v0.2.3更新于 Nov 6, 2026

Web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs.

概览

AI 生成的概览

通过付费的 Distill API 把网页或已有 HTML 转成干净的 Markdown,并遵守 robots.txt 与 AI 退出声明。

可以做什么
  • 抓取指定网址并返回正文 Markdown,附带标题、作者、日期和语言
  • 把已有的 HTML 直接转成 Markdown,不发起抓取
  • 当站点因 robots.txt、退出声明或机器人防护拒绝时,返回状态与提示
  • 返回 API 的 JSON 响应,市场提供时还包含本月剩余配额
适用场景
适合需要从网页获取可读正文而非原始 HTML 的场景,或希望抓取过程遵守 robots.txt 与 AI 退出声明。也适合在免费或低价 API 套餐下做轻量、偶尔的使用。
运行要求
通过 uvx 以 stdio 在本地运行(需 Python 3.10+,uv 会自动安装)。需要 RapidAPI 密钥(RAPIDAPI_KEY)或 api.market 密钥(API_MARKET_KEY);两者都设置时用 HFL_MARKETPLACE 选择市场。需要能访问 Distill API 的网络。
安装前请注意
Distill API 为付费服务,每次工具调用计为套餐中的一次请求,免费 Basic 套餐每月 15 次。页面内容以及你传入的本地文件路径会发送到该 API 处理。没有密钥时服务器仍可启动,但调用工具会失败并提示如何获取密钥。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Distill Mcp,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。

其他 MCP 客户端

参照 仓库 中的启动说明。

README

Distill MCP server

[M8ven Score] [CI] [PyPI] [Python 3.10+] [License: MIT]

Give your AI agent clean Markdown from any web page: the main content only, without navigation, ads or scripts. Distill honours robots.txt and AI opt-outs.

The server is open source (MIT). It calls the Distill API, which is paid, with a free plan.

  • You use your own key, from RapidAPI or api.market.
  • Every tool call is one request on your plan.
  • The free Basic plan has 15 requests a month, with a hard limit, so it never runs up a bill.

1. Get a key

marketplace
RapidAPIplans
api.marketstore

2. Add the server to your MCP client

The server runs locally over stdio with uv. Put your key in its environment.

JSON configuration (Claude Desktop, Cursor, VS Code and most clients):

json
{  "mcpServers": {    "distill": {      "command": "uvx",      "args": ["--from", "hybridforgelab-distill-mcp", "distill-mcp"],      "env": { "RAPIDAPI_KEY": "your-rapidapi-key" }    }  }}

Claude Code:

bash
claude mcp add distill --env RAPIDAPI_KEY=your-rapidapi-key -- uvx --from hybridforgelab-distill-mcp distill-mcp

Environment

variablemeaning
RAPIDAPI_KEYyour RapidAPI key
API_MARKET_KEYyour api.market key, used when RAPIDAPI_KEY is not set
HFL_MARKETPLACErapidapi or apimarket, when both keys are set

Without a key the server still starts. The first tool call then explains where to get one.

Also listed on Glama:

[distill-mcp on Glama]

3. Tools

toolwhat it does
fetch_markdown(url, max_chars=20000, include_links=True, include_images=False, include_tables=True)fetches the page and returns its main content as Markdown, with the title, author, date and language
html_to_markdown(html, base_url=None, …)the same, for HTML you already have; nothing is fetched

When a site refuses (robots.txt, a noai directive, bot protection), status says so and a note asks the agent to respect it. Don't fetch the page another way: the terms forbid it.

status is ok on success. Other values (robots_txt, opted_out, blocked, not_html, http_error, unreachable) explain why there is no content.

Every tool returns the API's JSON response.

  • When the marketplace reports it, quota_remaining is added: the requests left on your plan this month.
  • Errors are explained in plain words, with what to do next:
    • key refused, with the link to subscribe;
    • quota reached, with the plans;
    • input the API couldn't process, with the API's reason.

Privacy

  • Local files are read only when a tool is given their path. They are sent to the API for that one request.
  • The API processes inputs in memory and doesn't store them. See the privacy policy.
  • Your key is only sent to the marketplace you chose.

Limits

  • html up to 5 MB.
  • Only HTML pages; PDFs and other files are refused (use Unfold for documents).
  • The server needs Python 3.10+ (uv installs it for you).

Development

bash
uv venv && uv pip install -e ".[dev]".venv/bin/pytest            # unit tests, no network; 100% coverage required.venv/bin/ruff check src tests scripts

scripts/e2e_stdio.py distill runs the server over stdio, as a client would, and calls its tools against the real API. It needs RAPIDAPI_KEY or API_MARKET_KEY.

Licence

MIT. Distill itself is a paid API with a free plan, run by Hybrid Forge Lab.

来源:README.md,提交 4f6e466

工具

0
SourceWeft 曾在隔离沙箱中以无凭据方式启动该软件包一次,以列出其工具,但未能完成:该软件包类型无法在沙箱中运行。

版本历史

3
  1. v0.2.3最新Nov 6, 2026
  2. v0.2.2Nov 3, 2026
  3. v0.2.0Nov 3, 2026

评分

已满足适用检查项的 50%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通25 分

    请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。

  • 已声明认证方式10 分

    请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。

  • 已列出工具15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分