Distill Mcp

io.github.hybridforgelab由 GitHub 帳號 hybridforgelab 發布v0.2.3更新於 Nov 6, 2026

Web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs.

概覽

AI 產生的概覽

透過付費的 Distill API 把網頁或既有 HTML 轉成乾淨的 Markdown,並遵守 robots.txt 與 AI 退出聲明。

可以做什麼
  • 抓取指定網址並回傳正文 Markdown,附上標題、作者、日期與語言
  • 把既有的 HTML 直接轉成 Markdown,不進行抓取
  • 當網站因 robots.txt、退出聲明或機器人防護而拒絕時,回傳狀態與提示
  • 回傳 API 的 JSON 回應,市場有提供時另含本月剩餘額度
適用情境
適合需要從網頁取得可讀正文而非原始 HTML 的情境,或希望抓取過程遵守 robots.txt 與 AI 退出聲明。也適合在免費或低價 API 方案下做輕量、偶爾的使用。
執行需求
透過 uvx 以 stdio 在本機執行(需 Python 3.10+,uv 會自動安裝)。需要 RapidAPI 金鑰(RAPIDAPI_KEY)或 api.market 金鑰(API_MARKET_KEY);兩者都設定時以 HFL_MARKETPLACE 選擇市場。需要能連線至 Distill API 的網路。
安裝前請注意
Distill API 為付費服務,每次工具呼叫計為方案中的一次請求,免費 Basic 方案每月 15 次。頁面內容以及你傳入的本機檔案路徑會送到該 API 處理。沒有金鑰時伺服器仍可啟動,但呼叫工具會失敗並提示如何取得金鑰。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Distill Mcp,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

Distill MCP server

[M8ven Score] [CI] [PyPI] [Python 3.10+] [License: MIT]

Give your AI agent clean Markdown from any web page: the main content only, without navigation, ads or scripts. Distill honours robots.txt and AI opt-outs.

The server is open source (MIT). It calls the Distill API, which is paid, with a free plan.

  • You use your own key, from RapidAPI or api.market.
  • Every tool call is one request on your plan.
  • The free Basic plan has 15 requests a month, with a hard limit, so it never runs up a bill.

1. Get a key

marketplace
RapidAPIplans
api.marketstore

2. Add the server to your MCP client

The server runs locally over stdio with uv. Put your key in its environment.

JSON configuration (Claude Desktop, Cursor, VS Code and most clients):

json
{  "mcpServers": {    "distill": {      "command": "uvx",      "args": ["--from", "hybridforgelab-distill-mcp", "distill-mcp"],      "env": { "RAPIDAPI_KEY": "your-rapidapi-key" }    }  }}

Claude Code:

bash
claude mcp add distill --env RAPIDAPI_KEY=your-rapidapi-key -- uvx --from hybridforgelab-distill-mcp distill-mcp

Environment

variablemeaning
RAPIDAPI_KEYyour RapidAPI key
API_MARKET_KEYyour api.market key, used when RAPIDAPI_KEY is not set
HFL_MARKETPLACErapidapi or apimarket, when both keys are set

Without a key the server still starts. The first tool call then explains where to get one.

Also listed on Glama:

[distill-mcp on Glama]

3. Tools

toolwhat it does
fetch_markdown(url, max_chars=20000, include_links=True, include_images=False, include_tables=True)fetches the page and returns its main content as Markdown, with the title, author, date and language
html_to_markdown(html, base_url=None, …)the same, for HTML you already have; nothing is fetched

When a site refuses (robots.txt, a noai directive, bot protection), status says so and a note asks the agent to respect it. Don't fetch the page another way: the terms forbid it.

status is ok on success. Other values (robots_txt, opted_out, blocked, not_html, http_error, unreachable) explain why there is no content.

Every tool returns the API's JSON response.

  • When the marketplace reports it, quota_remaining is added: the requests left on your plan this month.
  • Errors are explained in plain words, with what to do next:
    • key refused, with the link to subscribe;
    • quota reached, with the plans;
    • input the API couldn't process, with the API's reason.

Privacy

  • Local files are read only when a tool is given their path. They are sent to the API for that one request.
  • The API processes inputs in memory and doesn't store them. See the privacy policy.
  • Your key is only sent to the marketplace you chose.

Limits

  • html up to 5 MB.
  • Only HTML pages; PDFs and other files are refused (use Unfold for documents).
  • The server needs Python 3.10+ (uv installs it for you).

Development

bash
uv venv && uv pip install -e ".[dev]".venv/bin/pytest            # unit tests, no network; 100% coverage required.venv/bin/ruff check src tests scripts

scripts/e2e_stdio.py distill runs the server over stdio, as a client would, and calls its tools against the real API. It needs RAPIDAPI_KEY or API_MARKET_KEY.

Licence

MIT. Distill itself is a paid API with a free plan, run by Hybrid Forge Lab.

來源:README.md,提交 4f6e466

工具

0
SourceWeft 曾在隔離沙箱中以無憑證方式啟動該軟體包一次,以列出其工具,但未能完成:該軟體包類型無法在沙箱中執行。

版本歷史

3
  1. v0.2.3最新Nov 6, 2026
  2. v0.2.2Nov 3, 2026
  3. v0.2.0Nov 3, 2026

評分

已滿足適用檢查項的 50%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分

    請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。

  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。

  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分