DeepSFetch

io.github.ermultimidia由 GitHub 账号 ermultimidia 发布v2.0.1更新于 Nov 2, 2026

Web scraping, extraction and search for AI agents. Hosted MCP with workspace API keys.

已验证Streamable HTTP可网页运行网页搜索与抓取知识与记忆

概览

AI 生成的概览

托管式 MCP 端点,让助手为 AI 代理与自动化抓取、提取和搜索网页内容,按工作区额度计费。

可以做什么
  • 提交网页与列表页的采集任务,可选择仅 HTTP 或启用浏览器回退。
  • 轮询与恢复采集任务,并在运行前估算所需额度。
  • 从 HTML、JSON-LD 或 CSS 选择器中提取名称、价格、货币等结构化字段。
  • 生成带来源元数据与内容哈希的干净文档分块,供 RAG 与向量库使用。
  • 为代理与自动化流程搜索网页并获取内容。
适用场景
当助手需要采集网页或列表数据、监控价格,或为 RAG 流程准备干净文档,又不想自行维护抓取与浏览器基础设施时使用。
运行要求
通过 streamable HTTP 连接的远程 MCP 端点,需在 Authorization 请求头中以 bearer 方式提供 DeepSFetch 工作区 API 密钥。需要 DeepSFetch 账号,采集会消耗工作区额度。
安装前请注意
采集会消耗付费工作区额度,建议设置明确的额度上限并先查看估算。API 密钥是工作区凭据,通过 Authorization 请求头发送。提交的页面与提取的数据会发送到托管的 DeepSFetch 服务,采集任务会把结果写入你的工作区。

安装

在 SourceWeft 中

  1. 打开 控制台中的 DeepSFetch,将其添加到工作区。
  2. 连接 Authorization token 凭据。它们会被私密存储,绝不会在公开页面上展示。
  3. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.ermultimidia%2Fdeepsfetch/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "deepsfetch": {
      "type": "http",
      "url": "https://mcp.deepsfetch.com/mcp",
      "headers": {
        "Authorization": "Bearer <YOUR_TOKEN>"
      }
    }
  }
}

README

English | Português

DeepSFetch Developer Kit

⭐ If these n8n workflows, SDKs, or MCP tools save you time, please give this repository a Star on GitHub! It helps other automation builders discover the toolkit.

[DeepSFetch n8n Workflow — Automated Collection & Price Monitoring]

Complete manual: 33 step-by-step guides — API, MCP, SDKs, CLI, collections, monitors, files, integrations and billing.

Collect web content for AI agents and automation with explicit credit limits.

Open-source JavaScript and Python clients, a CLI, and n8n integration code for the hosted DeepSFetch API. Start with one public HTML page, inspect the result, and build from there.

This repository contains client-side tools. The collection engine and hosted service are not included. Running the examples requires a DeepSFetch account and API key; collection consumes workspace credits. See current plans.

Ready-to-use n8n Workflows & Community Node

Automate structured HTML extraction in n8n with explicit credit caps, idempotency keys, and field validation before sending data to your alerts, spreadsheets, or AI/RAG pipelines.

Ready TemplateUse CaseWhat It Extracts & DeliversSetup & Download
Price MonitoringTrack product price changes on a scheduleValidated name, price, and currency (JSON-LD / CSS) with baseline comparisonConfigure & Download JSON · n8n Guide
Product CatalogExtract up to 100 items from a listing pageStructured item arrays with per-item field validation (no pagination)Configure & Download JSON · n8n Guide
AI / RAG DocumentationFeed clean documentation into vector stores or LLMsSource metadata, stable document IDs, content hash (change detection), and chunksConfigure & Download JSON · n8n Guide

Install the n8n Community Node (n8n-nodes-deepsfetch)

For self-hosted n8n, install via the UI (Settings → Community Nodes → Install → n8n-nodes-deepsfetch) or manually in your community nodes folder:

sh
npm install n8n-nodes-deepsfetch

(Using n8n Cloud? You can download the standard HTTP Request workflow templates directly from Guided Setup without installing a community node.)

📸 View n8n Node Configuration & Validated JSON Output Screenshots

1. Starting a Collection (Start Collection operation with payload & language selection): [DeepSFetch Start Collection Node in n8n]

2. Validated Output & Price Comparison (Compare price step with structured JSON result): [DeepSFetch Price Comparison Output in n8n]

Get your first result

Requires Node.js 22+. Create a key in API keys. From the repository root, set it for the current terminal session and run the dependency-free example:

PowerShell:

powershell
$env:DEEPSFETCH_API_KEY = 'YOUR_DEEPSFETCH_API_KEY'node examples/scrape.mjs https://example.com

macOS / Linux:

sh
export DEEPSFETCH_API_KEY='YOUR_DEEPSFETCH_API_KEY'node examples/scrape.mjs https://example.com

The example submits one HTTP-only collection with a maximum of 3 DeepSFetch credits and browser fallback disabled, then polls the same job. It prints the completed job as JSON. This cap is not a promise of a free or successful collection. JavaScript-dependent pages need another configuration. See getting started for failure handling and resuming a job.

Choose your integration

ToolInstall or guideWhat is included
JavaScript SDKnpm install @deepsfetch/sdkAPI v2 client and job polling
CLInpm install -g @deepsfetch/cliCommands for collection, jobs and estimates
Python SDKpython -m pip install ./packages/deepsfetch-sdk-pythonSource installation; PyPI release pending
MCPRemote connection guideConfiguration for the hosted MCP endpoint
n8nnpm install n8n-nodes-deepsfetch · GuideSource for the npm-published community node

The remote MCP server implementation is not included here. The n8n node is not verified by n8n. The remote MCP is listed in the official registry. Native partnerships and a self-hosted collection engine are not claimed by this repository.

CLI quickstart

After installing the CLI and setting the environment variable above:

sh
deepsfetch scrape --file examples/scrape-request.json --wait

The CLI writes its idempotency key to stderr. If a submission's outcome is unknown, retry the same request with --idempotency-key THE_SAME_KEY. Once you have a job ID, use deepsfetch job JOB_ID --wait instead of submitting another collection.

Open tools and hosted service

CapabilityIn this repositoryHosted DeepSFetch
JavaScript SDK, Python SDK, CLISource and testsConnect to API v2
n8n community nodeSource distributed as JavaScriptCalls collection integration endpoints
MCPConnection guideRemote server
Collection engine, browser infrastructureNot includedManaged by DeepSFetch
Accounts, credits, billing and dashboardNot includedManaged by DeepSFetch

Develop locally

sh
npm install --ignore-scripts
npm test
npm run check

Run Python tests from the repository root:

sh
python -m pip install ./packages/deepsfetch-sdk-python
python -m unittest discover -s packages/deepsfetch-sdk-python/tests

Tests use fixtures and a local HTTP server; they do not submit paid collections. See contributing, security, and the roadmap.

Resources

MIT license applies to the tools in this repository. Using the hosted service is subject to its own terms and credit limits.

Try it and share feedback

Read the first-collection tutorial, run the operational smoke test, and share your first-run experience.

The authenticated Firecrawl comparison includes results, limitations and reproducible code. The published DEV tutorial walks through signup, first collection and MCP. Also see the Smithery listing, with instructions and limits in the MCP guide.

来源:README.md,提交 3b22714

工具

0
该服务器需要 API 密钥等凭据,因此 SourceWeft 无法在没有凭据的情况下读取其工具,也未收录。

版本历史

1
  1. v2.0.1最新Oct 11, 2026

评分

已满足适用检查项的 75%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分

    请在仓库或注册中心条目中声明许可证。