Webfetch.io

io.webfetch由 webfetch.io 发布官方发布者v1.0.0更新于 Nov 22, 2026

Fetch any URL as markdown, text, HTML or selector-built JSON; search Google, Bing, Yahoo and Brave.

已验证Streamable HTTP可网页运行网页搜索与抓取浏览器自动化

概览

AI 生成的概览

远程 MCP 服务器,让助手把任意网址抓取为 Markdown、纯文本、HTML 或用选择器构建的 JSON,并可搜索 Google、Bing、Yahoo 和 Brave。

可以做什么
  • 把网址抓取为 Markdown、纯文本或原始 HTML,默认渲染 JavaScript
  • 用 CSS 或 XPath 选择器从页面提取指定字段并以 JSON 返回
  • 搜索 Google、Bing、Yahoo 或 Brave,以 JSON 返回自然结果、广告、相关搜索和问题
适用场景
适合助手需要实时网页内容的场景:读取已知网址的页面、从页面中提取价格或表格等特定字段,或在还没有网址时先搜索找到页面。
运行要求
远程 Streamable HTTP 端点,无需本地安装包。每次请求都必须以 Authorization Bearer 令牌形式提供 API 密钥;免费密钥初始 1,000 积分,每月再送 250 积分。搜索功能需在密钥上开通搜索权限,这要求付费方案并开启 robots.txt 退出选项。
安装前请注意
调用按积分计费:不渲染 JavaScript 的抓取 1 积分,渲染为 5 积分,搜索每页 10 积分(light_request 为 false 时 15 积分);失败的调用不计费。密钥以 Bearer 令牌随每次请求发送,需妥善保管。搜索权限取决于密钥上的 robots.txt 退出设置。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Webfetch.io,将其添加到工作区。
  2. 连接 Authorization token 凭据。它们会被私密存储,绝不会在公开页面上展示。
  3. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.webfetch%2Fwebfetch/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "webfetch-io": {
      "type": "http",
      "url": "https://webfetch.io/mcp",
      "headers": {
        "Authorization": "Bearer <YOUR_TOKEN>"
      }
    }
  }
}

README

Webfetch SDKs

Official clients for the webfetch.io scraping and search API, in JavaScript, Python and PHP. MIT licensed.

Each one wraps GET https://api.webfetch.io/v1/ and the search endpoints (/v1/google, /v1/bing, /v1/yahoo, /v1/brave). The API is ScrapingBee-compatible, so parameter names, defaults and credit costs match.

LanguageInstallRequires
JavaScriptnpm install @tuxxin/webfetchNode 18+, no runtime dependencies
Pythonpip install webfetch-io (imports as webfetch)Python 3.9+, httpx
PHPcomposer require tuxxin/webfetchPHP 8.1+, ext-curl

The shape is the same in all three

client = Webfetch(api_key)result = client.fetch(url, render_js=True, ...)
result.content     the page, as bytes or a stringresult.credits     what this call cost, from the Wf-Cost headerresult.status      the status the target returnedresult.resolved_url  where it ended up after redirects

Search

results = client.bing("python asyncio tutorial", country_code="us")results["organic_results"]   [{position, title, url, displayed_url, description, ...}]results["top_ads"]           [{position, title, url, tracking_url, domain, ...}]
client.search("yahoo", query, search_type="ads")   the ads only, same price

The response has the shape of ScrapingBee's Google Search API. Needs a paid plan with the robots.txt opt-out turned on for the key in the key portal: every engine's robots.txt disallows its result pages. Google, Bing, Yahoo and Brave are all open. 10 credits a page, 15 with light_request false; a failed search costs nothing. Reference: https://webfetch.io/documentation#search.

Credits

RequestCredits
No JavaScript rendering1
JavaScript rendering (the default)5
Premium proxy10, or 25 with rendering
Stealth proxy75
Search, light request (the default)10
Search, light_request false15
Any failed request0

mode=auto tries those routes cheapest first and charges only the one that worked; max_cost caps it. An anti-bot challenge or CAPTCHA page is never charged.

render_js defaults to true, so a call that does not set it costs 5 credits. Pass render_js=false for a plain HTTP fetch at 1 credit.

A key is required

There is no keyless tier. A free account starts with 1,000 credits and gets 250 more each month (banking up to 1,000), and needs only a confirmed email address. Each client raises WebfetchError immediately when constructed without a key, rather than spending a round trip on a request that cannot succeed.

Errors

Every SDK raises the same three-level hierarchy, so you can catch broadly or narrowly:

WebfetchError            anything went wrong  WebfetchApiError       the API answered with an error status; carries .status and .code    WebfetchRateLimitError   429, or 503 when free capacity is busy; carries .retry_after

A failed call is never billed, so you do not need to reconcile credits after an error.

MCP server

Webfetch is also a remote MCP server, so an AI assistant can fetch pages and run searches as tools, with no SDK in between.

Endpointhttps://webfetch.io/mcp (Streamable HTTP, POST only)
Registryio.webfetch/webfetch in the official MCP Registry; manifest: server.json
AuthAuthorization: Bearer wfk_... on every request. A free key starts with 1,000 credits and gets 250 more each month
Docshttps://webfetch.io/documentation#mcp
ToolWhat it does
fetch_pageA URL as markdown, plain text or raw HTML. JavaScript is rendered by default (5 credits); render_js false is a plain fetch (1 credit)
extract_dataJSON built from CSS or XPath selectors, so the model gets fields instead of a whole page
search_webOne page of Google, Bing, Yahoo or Brave results as JSON: organic results, ads, related searches and questions. 10 credits a page; needs search access on the key

A failed call costs nothing. Claude Code, in .mcp.json:

json
{  "mcpServers": {    "webfetch": {      "type": "http",      "url": "https://webfetch.io/mcp",      "headers": { "Authorization": "Bearer ${WEBFETCH_KEY}" }    }  }}

Documentation

https://webfetch.io/documentation

来源:README.md,提交 d5ce09c

工具

3

fetch_page

Fetch a web page

Fetch one URL and return the page as markdown, plain text or raw HTML. Use it to read a page whose URL you have; use extract_data instead for specific fields as JSON, and search_web when you have no URL yet. JavaScript is rendered by default (5 credits); render_js false is a plain HTTP fetch (1 credit). The result is a summary line (host, credits charged) and then the content, cut at 100,000 characters, which the summary notes. A failed fetch returns isError with the HTTP status and reason, and costs nothing.

输入参数url必填render_jsreturn_format

extract_data

Extract structured data from a page

Fetch one URL and return JSON built from CSS or XPath selectors: named fields instead of a whole page. Use it when you know which elements hold the data (prices, titles, links, tables); read the page with fetch_page first if you do not. It costs what fetch_page costs. A rule that matches nothing returns null (item) or [] (list) and the call still succeeds, so check for nulls. An invalid rule or a failed fetch returns isError with the reason, and costs nothing. Output is cut at 100,000 characters.

输入参数url必填render_jsextract_rules必填

search_web

Search the web

Search Google, Bing, Yahoo and Brave (one engine per call) and return one results page as JSON: organic_results (position, title, url, description, date), top_ads, bottom_ads, related_searches, questions and number_of_results. Use it to find pages when you have no URL; then read a result with fetch_page or pull fields from it with extract_data. 10 credits per page. Needs search access on the key: paid plans turn on the robots.txt opt-out in the key portal, and free accounts request it there. Without it, or on any failure, the call returns isError with the reason, and costs nothing.

输入参数pagequery必填enginesearch_typecountry_codelight_request

版本历史

1
  1. v1.0.0最新Nov 22, 2026

评分

已满足适用检查项的 100%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分

其他 Webfetch 集成