
FetchV2
io.github.praveenc由 GitHub 账号 praveenc 发布v2.0.0更新于 Oct 24, 2026
Fetch and extract web pages, discover links, and read llms.txt documentation indexes.
概览
一个本地 MCP 服务器,可抓取网页、提取正文为干净的 Markdown、发现页面链接,并读取 llms.txt 文档索引。
- 可以做什么
- 抓取单个网页并提取正文为 Markdown,可选返回原始 HTML、元数据、表格、链接,并按字符偏移分页。一次批量抓取最多 10 个网页并合并结果。发现页面上的链接并用正则过滤,自动解析相对链接。读取 llms.txt 索引,并可选抓取其链接的所有页面。提供内置提示词,用于抓取并总结某个网址或研究某个主题。
- 适用场景
- 适合需要以干净文本读取网页文档或文章、一次收集多个页面,或处理基于 llms.txt 的文档站点的场景。适用于原始 HTML 过于杂乱的资料检索与文档工作流。
- 运行要求
- 以 Python 包(fetchv2-mcp-server)形式通过 uvx 或 pip 在本地以 stdio 运行。需要 uv 和 Python 3.11 或更高版本。未声明任何账号、API 密钥、环境变量或请求头。需要能访问目标站点的网络。
安装
在 SourceWeft 中
- 打开 控制台中的 FetchV2,将其添加到工作区。
- 为需要使用其工具的对话启用该服务。
Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。
其他 MCP 客户端
参照 仓库 中的启动说明。
README
FetchV2 MCP Server
[PyPI version] [CI] [Python 3.11+] [License: MIT]
FetchV2 is a Model Context Protocol (MCP) server that retrieves web pages and returns clean Markdown. It uses Trafilatura to remove navigation, advertisements, footers, and other page elements.
What it does
FetchV2 can return raw HTML, preserve links and tables, and paginate long content.
The fetch tool checks robots.txt by default.
Quick start
Requirements
- Install
uv. - Install Python 3.11 or newer:
Install for Cursor or VS Code
Configure another MCP client
Add this server definition to your MCP client configuration:
Common configuration file locations:
- Claude Desktop on macOS:
~/Library/Application Support/Claude/claude_desktop_config.json - Claude Desktop on Windows:
%APPDATA%\Claude\claude_desktop_config.json - Windsurf:
~/.codeium/windsurf/mcp_config.json - Kiro:
.kiro/settings/mcp.jsonin your project
Install in a Python environment
Use one of these commands if you want to install the package directly:
Try it
Ask your MCP client to perform a task such as:
- "Fetch the documentation from
<URL>." - "Find links on
<docs URL>that containtutorial." - "Read these pages and summarize their differences:
[url1, url2, url3]."
Typical documentation workflow
First, find the relevant pages:
Then fetch the selected pages in one request:
Tool reference
fetch
Fetch one web page and extract its main content as Markdown.
If the response is truncated, use the returned start_index value in the next call.
fetch_batch
Fetch up to 10 web pages and combine the results.
This tool reports a failed URL in its result and continues with the other URLs.
It does not check robots.txt.
discover_links
Find links on a web page and optionally filter them with a regular expression.
The tool resolves relative links and returns up to 100 URLs.
fetch_llms_txt
Read an llms.txt file and list its documentation links.
By default, this tool fetches only the llms.txt index.
Set include_content=True to fetch all linked pages.
This option can return a large response.
The tool resolves relative URLs, such as /docs/guide.md, against the llms.txt URL.
Prompts
fetch_manualcreates a request to fetch and summarize one URL.research_topiccreates a request to research a topic with optional URLs.
Development
Clone the repository and install the development dependencies:
Run the tests:
Run the server with MCP Inspector:
Run lint and type checks:
Contributing
Read CONTRIBUTING.md before you submit a change.
Support
Use the GitHub issue tracker to report a problem or request a feature.
License
This project uses the MIT License. See LICENSE for details.
来源:README.md,提交 b6a920d
工具
0版本历史
1- v2.0.0最新Sep 16, 2026
评分
已满足适用检查项的 50%
该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。
- 近 30 天内可连通25 分
请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。
- 已声明认证方式10 分
请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。
- 已列出工具15 分
请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。
- 描述必需15 分
- 图标10 分
- 文档15 分
- 许可证10 分
