DeepSFetch

io.github.ermultimidia由 GitHub 帳號 ermultimidia 發布v2.0.1更新於 Nov 2, 2026

Web scraping, extraction and search for AI agents. Hosted MCP with workspace API keys.

已驗證Streamable HTTP可網頁執行網頁搜尋與抓取知識與記憶

概覽

AI 產生的概覽

託管式 MCP 端點,讓助理為 AI 代理與自動化抓取、擷取和搜尋網頁內容,依工作區額度計費。

可以做什麼
  • 提交網頁與列表頁的採集工作,可選擇僅 HTTP 或啟用瀏覽器備援。
  • 輪詢與續接採集工作,並在執行前估算所需額度。
  • 從 HTML、JSON-LD 或 CSS 選擇器擷取名稱、價格、幣別等結構化欄位。
  • 產生附來源中繼資料與內容雜湊的乾淨文件切塊,供 RAG 與向量資料庫使用。
  • 為代理與自動化流程搜尋網頁並取得內容。
適用情境
當助理需要採集網頁或列表資料、監控價格,或為 RAG 流程準備乾淨文件,又不想自行維護抓取與瀏覽器基礎設施時使用。
執行需求
透過 streamable HTTP 連線的遠端 MCP 端點,需在 Authorization 標頭以 bearer 方式提供 DeepSFetch 工作區 API 金鑰。需要 DeepSFetch 帳號,採集會消耗工作區額度。
安裝前請注意
採集會消耗付費工作區額度,建議設定明確的額度上限並先查看估算。API 金鑰是工作區憑證,透過 Authorization 標頭傳送。提交的頁面與擷取的資料會送到託管的 DeepSFetch 服務,採集工作會把結果寫入你的工作區。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 DeepSFetch,將其新增到工作區。
  2. 連接 Authorization token 憑證。它們會被私密儲存,絕不會在公開頁面上展示。
  3. 為需要使用其工具的對話啟用該服務。

Web executable,透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

交給代理程式安裝

把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式,或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南,先向你展示發布者、端點和登入方式,經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。

閱讀 https://sourceweft.com/mcp/io.github.ermultimidia%2Fdeepsfetch/install.md,並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前,先告訴我它的發布者、端點和登入方式,等我確認。不要把 API 金鑰寫進命令或我會提交的檔案;問我金鑰應從哪裡取得。

檢視代理程式所依據的安裝指南

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。

{
  "mcpServers": {
    "deepsfetch": {
      "type": "http",
      "url": "https://mcp.deepsfetch.com/mcp",
      "headers": {
        "Authorization": "Bearer <YOUR_TOKEN>"
      }
    }
  }
}

README

English | Português

DeepSFetch Developer Kit

⭐ If these n8n workflows, SDKs, or MCP tools save you time, please give this repository a Star on GitHub! It helps other automation builders discover the toolkit.

[DeepSFetch n8n Workflow — Automated Collection & Price Monitoring]

Complete manual: 33 step-by-step guides — API, MCP, SDKs, CLI, collections, monitors, files, integrations and billing.

Collect web content for AI agents and automation with explicit credit limits.

Open-source JavaScript and Python clients, a CLI, and n8n integration code for the hosted DeepSFetch API. Start with one public HTML page, inspect the result, and build from there.

This repository contains client-side tools. The collection engine and hosted service are not included. Running the examples requires a DeepSFetch account and API key; collection consumes workspace credits. See current plans.

Ready-to-use n8n Workflows & Community Node

Automate structured HTML extraction in n8n with explicit credit caps, idempotency keys, and field validation before sending data to your alerts, spreadsheets, or AI/RAG pipelines.

Ready TemplateUse CaseWhat It Extracts & DeliversSetup & Download
Price MonitoringTrack product price changes on a scheduleValidated name, price, and currency (JSON-LD / CSS) with baseline comparisonConfigure & Download JSON · n8n Guide
Product CatalogExtract up to 100 items from a listing pageStructured item arrays with per-item field validation (no pagination)Configure & Download JSON · n8n Guide
AI / RAG DocumentationFeed clean documentation into vector stores or LLMsSource metadata, stable document IDs, content hash (change detection), and chunksConfigure & Download JSON · n8n Guide

Install the n8n Community Node (n8n-nodes-deepsfetch)

For self-hosted n8n, install via the UI (Settings → Community Nodes → Install → n8n-nodes-deepsfetch) or manually in your community nodes folder:

sh
npm install n8n-nodes-deepsfetch

(Using n8n Cloud? You can download the standard HTTP Request workflow templates directly from Guided Setup without installing a community node.)

📸 View n8n Node Configuration & Validated JSON Output Screenshots

1. Starting a Collection (Start Collection operation with payload & language selection): [DeepSFetch Start Collection Node in n8n]

2. Validated Output & Price Comparison (Compare price step with structured JSON result): [DeepSFetch Price Comparison Output in n8n]

Get your first result

Requires Node.js 22+. Create a key in API keys. From the repository root, set it for the current terminal session and run the dependency-free example:

PowerShell:

powershell
$env:DEEPSFETCH_API_KEY = 'YOUR_DEEPSFETCH_API_KEY'node examples/scrape.mjs https://example.com

macOS / Linux:

sh
export DEEPSFETCH_API_KEY='YOUR_DEEPSFETCH_API_KEY'node examples/scrape.mjs https://example.com

The example submits one HTTP-only collection with a maximum of 3 DeepSFetch credits and browser fallback disabled, then polls the same job. It prints the completed job as JSON. This cap is not a promise of a free or successful collection. JavaScript-dependent pages need another configuration. See getting started for failure handling and resuming a job.

Choose your integration

ToolInstall or guideWhat is included
JavaScript SDKnpm install @deepsfetch/sdkAPI v2 client and job polling
CLInpm install -g @deepsfetch/cliCommands for collection, jobs and estimates
Python SDKpython -m pip install ./packages/deepsfetch-sdk-pythonSource installation; PyPI release pending
MCPRemote connection guideConfiguration for the hosted MCP endpoint
n8nnpm install n8n-nodes-deepsfetch · GuideSource for the npm-published community node

The remote MCP server implementation is not included here. The n8n node is not verified by n8n. The remote MCP is listed in the official registry. Native partnerships and a self-hosted collection engine are not claimed by this repository.

CLI quickstart

After installing the CLI and setting the environment variable above:

sh
deepsfetch scrape --file examples/scrape-request.json --wait

The CLI writes its idempotency key to stderr. If a submission's outcome is unknown, retry the same request with --idempotency-key THE_SAME_KEY. Once you have a job ID, use deepsfetch job JOB_ID --wait instead of submitting another collection.

Open tools and hosted service

CapabilityIn this repositoryHosted DeepSFetch
JavaScript SDK, Python SDK, CLISource and testsConnect to API v2
n8n community nodeSource distributed as JavaScriptCalls collection integration endpoints
MCPConnection guideRemote server
Collection engine, browser infrastructureNot includedManaged by DeepSFetch
Accounts, credits, billing and dashboardNot includedManaged by DeepSFetch

Develop locally

sh
npm install --ignore-scripts
npm test
npm run check

Run Python tests from the repository root:

sh
python -m pip install ./packages/deepsfetch-sdk-python
python -m unittest discover -s packages/deepsfetch-sdk-python/tests

Tests use fixtures and a local HTTP server; they do not submit paid collections. See contributing, security, and the roadmap.

Resources

MIT license applies to the tools in this repository. Using the hosted service is subject to its own terms and credit limits.

Try it and share feedback

Read the first-collection tutorial, run the operational smoke test, and share your first-run experience.

The authenticated Firecrawl comparison includes results, limitations and reproducible code. The published DEV tutorial walks through signup, first collection and MCP. Also see the Smithery listing, with instructions and limits in the MCP guide.

來源:README.md,提交 3b22714

工具

0
該伺服器需要 API 金鑰等憑證,因此 SourceWeft 無法在沒有憑證的情況下讀取其工具,也未收錄。

版本歷史

1
  1. v2.0.1最新Oct 11, 2026

評分

已滿足適用檢查項的 75%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通必需25 分
  • 已宣告認證方式必需10 分
  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分

    請在儲存庫或註冊中心條目中宣告授權條款。