Distill Mcp

io.github.Bytestay由 GitHub 账号 Bytestay 发布v0.2.4更新于 Nov 6, 2026

Web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs.

概览

AI 生成的概览

通过付费的 Distill API 把网页或已有 HTML 转成干净的 Markdown,并遵守 robots.txt 与 AI 退出声明。

可以做什么
  • 按网址抓取网页,返回正文 Markdown,并附标题、作者、日期和语言
  • 把已有的 HTML 直接转成 Markdown,不发起抓取
  • 可设置最大字符数、是否包含链接、图片和表格
  • 当站点因 robots.txt、AI 退出声明、机器人防护或 HTTP 错误拒绝时,返回状态与提示
  • 返回 API 的 JSON 响应,市场方提供时还包含本月剩余配额
适用场景
适合需要网页正文而非原始 HTML 的场景,例如研究、摘要或做笔记;也适合希望抓取过程尊重站点退出声明、而不是绕过限制的用户。
运行要求
以 uvx 通过 stdio 在本机运行(需 Python 3.10+,uv 会自动安装)。需要 RapidAPI 或 api.market 的付费 Distill API 密钥,通过 RAPIDAPI_KEY 或 API_MARKET_KEY 设置;两者都设置时用 HFL_MARKETPLACE 选择市场。需要网络访问。没有密钥也能启动,但首次调用工具时会提示如何获取。
安装前请注意
每次工具调用都会消耗套餐中的一次请求;免费 Basic 套餐每月 15 次,为硬性上限。页面网址以及传入的 HTML 或本地文件路径会发送给 Distill API,密钥只发送给所选市场。仅支持 HTML,PDF 等文件会被拒绝。条款禁止改用其他方式抓取被拒绝的页面。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Distill Mcp,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。

其他 MCP 客户端

参照 仓库 中的启动说明。

README

Distill MCP server

[M8ven Score] [CI] [PyPI] [Python 3.10+] [License: MIT]

Give your AI agent clean Markdown from any web page: the main content only, without navigation, ads or scripts. Distill honours robots.txt and AI opt-outs.

The server is open source (MIT). It calls the Distill API, which is paid, with a free plan.

  • You use your own key, from RapidAPI or api.market.
  • Every tool call is one request on your plan.
  • The free Basic plan has 15 requests a month, with a hard limit, so it never runs up a bill.

1. Get a key

marketplace
RapidAPIplans
api.marketstore

2. Add the server to your MCP client

The server runs locally over stdio with uv. Put your key in its environment.

JSON configuration (Claude Desktop, Cursor, VS Code and most clients):

json
{  "mcpServers": {    "distill": {      "command": "uvx",      "args": ["--from", "bytestay-distill-mcp", "distill-mcp"],      "env": { "RAPIDAPI_KEY": "your-rapidapi-key" }    }  }}

Claude Code:

bash
claude mcp add distill --env RAPIDAPI_KEY=your-rapidapi-key -- uvx --from bytestay-distill-mcp distill-mcp

Environment

variablemeaning
RAPIDAPI_KEYyour RapidAPI key
API_MARKET_KEYyour api.market key, used when RAPIDAPI_KEY is not set
HFL_MARKETPLACErapidapi or apimarket, when both keys are set

Without a key the server still starts. The first tool call then explains where to get one.

Also listed on Glama:

[distill-mcp on Glama]

3. Tools

toolwhat it does
fetch_markdown(url, max_chars=20000, include_links=True, include_images=False, include_tables=True)fetches the page and returns its main content as Markdown, with the title, author, date and language
html_to_markdown(html, base_url=None, …)the same, for HTML you already have; nothing is fetched

When a site refuses (robots.txt, a noai directive, bot protection), status says so and a note asks the agent to respect it. Don't fetch the page another way: the terms forbid it.

status is ok on success. Other values (robots_txt, opted_out, blocked, not_html, http_error, unreachable) explain why there is no content.

Every tool returns the API's JSON response.

  • When the marketplace reports it, quota_remaining is added: the requests left on your plan this month.
  • Errors are explained in plain words, with what to do next:
    • key refused, with the link to subscribe;
    • quota reached, with the plans;
    • input the API couldn't process, with the API's reason.

Privacy

  • Local files are read only when a tool is given their path. They are sent to the API for that one request.
  • The API processes inputs in memory and doesn't store them. See the privacy policy.
  • Your key is only sent to the marketplace you chose.

Limits

  • html up to 5 MB.
  • Only HTML pages; PDFs and other files are refused (use Unfold for documents).
  • The server needs Python 3.10+ (uv installs it for you).

Development

bash
uv venv && uv pip install -e ".[dev]".venv/bin/pytest            # unit tests, no network; 100% coverage required.venv/bin/ruff check src tests scripts

scripts/e2e_stdio.py distill runs the server over stdio, as a client would, and calls its tools against the real API. It needs RAPIDAPI_KEY or API_MARKET_KEY.

Licence

MIT. Distill itself is a paid API with a free plan, run by ByteStay.

来源:README.md,提交 93a2ab7

工具

0
SourceWeft 曾在隔离沙箱中以无凭据方式启动该软件包一次,以列出其工具,但未能完成:该软件包类型无法在沙箱中运行。

版本历史

1
  1. v0.2.4最新Nov 6, 2026

评分

已满足适用检查项的 50%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通25 分

    请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。

  • 已声明认证方式10 分

    请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。

  • 已列出工具15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分