Vanshulgoyal101

io.github.vanshulgoyal101由 GitHub 账号 vanshulgoyal101 发布v1.0.0更新于 Oct 24, 2026

Read any web page as clean Markdown for AI agents: fetch, search, metadata, links. SSRF-safe.

已验证Streamable HTTP可网页运行网页搜索与抓取知识与记忆

概览

AI 生成的概览

远程 MCP 服务器,让助手把实时网页抓取为干净的 Markdown、页面元数据、外链或按查询匹配的段落。

可以做什么
  • 把网页正文抓取为干净的 Markdown,可限制最大字符数
  • 在页面内按查询检索,只返回匹配段落,按相关度排序并附标题层级路径
  • 读取页面元数据,如标题、作者、站点名、摘要和字数
  • 提取页面所有对外 http(s) 链接及锚文本,便于爬取或查找相关页面
适用场景
适合助手需要阅读实时网页上的文章、文档或纯文本/JSON 接口,或想从长页面中只取某个具体细节而不必消耗大量 token 读取全文的场景。
运行要求
一个基于 Streamable HTTP 的远程 MCP 端点;未声明需要账号、API 密钥或环境变量。仅支持 stdio 的客户端可用 mcp-remote 这个 npm 包桥接,需要 Node.js。
安装前请注意
服务器会代助手抓取任意公开网址,返回的页面内容属于不可信的第三方文本。它无状态、不存储页面内容,并会拦截 localhost、私有网段和云元数据地址。请求按 IP 限流。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Vanshulgoyal101,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.vanshulgoyal101%2Fmcp/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "vanshulgoyal101": {
      "type": "http",
      "url": "https://mcp.vanshul.com/mcp"
    }
  }
}

README

mcp.vanshul.com

[MCP Registry] [Endpoint]

A public Model Context Protocol (MCP) server, running as a Cloudflare Worker, that lets any AI agent read the live web as clean Markdown. It builds on the same extraction pipeline as the sibling reader/ project (Mozilla Readability + Turndown), exposed over the MCP Streamable HTTP transport so agentic clients can plug straight in.

Endpoint

POST https://mcp.vanshul.com/mcp     # JSON-RPC 2.0 (MCP)GET  https://mcp.vanshul.com/health  # { ok: true, tools: [...] }

Tools

ToolInputReturns
fetch_markdown{ url, max_chars? }The page's main content as clean Markdown (optionally truncated to max_chars)
search_page{ url, query, max_matches?, context_chars? }Only the passages matching query, each with its heading breadcrumb, ranked by relevance — token-efficient alternative to fetch_markdown
fetch_metadata{ url }JSON: title, byline, siteName, excerpt, wordCount
extract_links{ url, limit? }JSON: all outbound http(s) links + anchor text

Connect from an MCP client

Remote/HTTP-capable clients (Claude Desktop, Cursor, Continue, …):

json
{  "mcpServers": {    "web-reader": { "url": "https://mcp.vanshul.com/mcp" }  }}

Stdio-only clients can bridge with mcp-remote:

sh
npx mcp-remote https://mcp.vanshul.com/mcp

Add it to your client

  • Cursor — Settings → MCP → Add new server, or drop this into ~/.cursor/mcp.json:
    json
    { "mcpServers": { "web-reader": { "url": "https://mcp.vanshul.com/mcp" } } }
  • Claude Desktop — add the same block to claude_desktop_config.json (Settings → Developer → Edit Config). If your version is stdio-only, use:
    json
    { "mcpServers": { "web-reader": { "command": "npx", "args": ["mcp-remote", "https://mcp.vanshul.com/mcp"] } } }
  • Continue / VS Code — add web-reader with URL https://mcp.vanshul.com/mcp to your MCP servers config.

Try it with curl

sh
curl -s https://mcp.vanshul.com/mcp \  -H 'content-type: application/json' \  -d '{"jsonrpc":"2.0","id":1,"method":"tools/list"}'
curl -s https://mcp.vanshul.com/mcp \  -H 'content-type: application/json' \  -d '{"jsonrpc":"2.0","id":2,"method":"tools/call",       "params":{"name":"fetch_markdown","arguments":{"url":"https://example.com"}}}'
# Return only the passages matching a query (token-efficient):curl -s https://mcp.vanshul.com/mcp \  -H 'content-type: application/json' \  -d '{"jsonrpc":"2.0","id":3,"method":"tools/call",       "params":{"name":"search_page","arguments":{"url":"https://example.com","query":"more information"}}}'

Layout

mcp/├── src/│   ├── worker.ts     # entry: routes /mcp, /health, rate limit, CORS│   ├── mcp.ts        # JSON-RPC dispatch + tool definitions│   ├── extract.ts    # HTML -> Markdown / links (Readability + Turndown)│   ├── search.ts     # query-focused passage search over extracted Markdown│   ├── fetcher.ts    # fetch with timeout, size cap, re-validated redirects│   └── security.ts   # SSRF guard (block private/internal addresses)├── public/│   ├── index.html    # landing page (served for non-API paths)│   ├── og.png        # social share image (1200×630)│   ├── og.svg        # social image source│   ├── robots.txt│   └── sitemap.xml├── tests/            # vitest: security, extract, search, mcp dispatch, fetcher, worker├── wrangler.toml├── package.json├── tsconfig.json└── README.md

Develop & deploy

sh
cd mcpnpm installnpm run typechecknpm test          # vitest — security, extraction, search, MCP dispatch, fetcher, workernpm run dev        # local worker at http://localhost:8787  (POST /mcp)npm run deploy     # wrangler deploy

After the first deploy, attach the custom domain mcp.vanshul.com in the Cloudflare dashboard (Workers & Pages → this worker → Settings → Domains), or uncomment the [[routes]] block in wrangler.toml.

Security

  • SSRF-safe: only public http(s) URLs; localhost, private ranges, cloud metadata and every redirect hop are blocked/re-validated.
  • Bounded: 10s fetch timeout, ~3 MB page cap, max 5 redirects, per-IP rate limit.
  • Stateless & private: no page content is stored; extraction is deterministic with no LLM in the loop.

MCP protocol

Implements initialize, ping, tools/list, tools/call and notifications (protocol version 2025-06-18). Tool failures are returned as { content, isError: true } so the agent can read the message and recover; malformed requests use standard JSON-RPC error codes.

Documentation

License

MIT © Vanshul Goyal

来源:README.md,提交 20b88d4

工具

4

fetch_markdown

Fetch a web page and return its main content as clean Markdown (nav, ads and boilerplate removed). Raw Markdown, plain-text and JSON endpoints are returned as-is. Use this to read an article, docs page or raw file.

输入参数url必填max_chars

fetch_metadata

Fetch a web page and return its metadata as JSON: title, byline, site name, excerpt and word count (no full body).

输入参数url必填

search_page

Fetch a web page and return only the passages that match a query, instead of the whole page. Each result includes its heading breadcrumb and is ranked by relevance. Use this to find a specific detail (e.g. pricing, a config option) while spending far fewer tokens than fetch_markdown.

输入参数url必填query必填max_matchescontext_chars

版本历史

1
  1. v1.0.0最新Sep 16, 2026

评分

已满足适用检查项的 100%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分