NodeProxy Web Surface Markdown Parser

io.github.pgalyen1987由 GitHub 账号 pgalyen1987 发布v1.1.2更新于 Oct 25, 2026

x402 MCP web parser: URLs to Markdown for agents. USDC on Base, Polygon, Arbitrum, Ethereum.

发布方自己的服务:Parser Club

已验证Streamable HTTP可网页运行网页搜索与抓取浏览器自动化

概览

AI 生成的概览

付费的网页转 Markdown 解析 MCP 服务器,抓取公开网址并返回干净、压缩的 Markdown 供助手使用。

可以做什么
抓取公开网址并返回压缩的语义 Markdown,去除脚本、广告和导航噪声,适用于普通页面,按次低价计费。通过加固的无头浏览器和拟真浏览器配置抓取 JavaScript 密集型或 SPA 页面,返回完整渲染的 Markdown,按次高价计费。两个档位都旨在让内容繁重的网站抓取循环更省 token。
适用场景
当助手需要可读的网页内容而非原始 HTML 时适用,尤其是会大量消耗上下文的 React 或 Vue 站点,或基础抓取被轻度反爬拦截、需要渲染版本时。
运行要求
可作为远程 streamable HTTP 端点运行,也可通过 nodeproxy-tools(PyPI)或 @nodeproxy/langchain(npm)包以 stdio 本地运行。调用需付费:通过 x402 使用 Base、Polygon、Arbitrum 或 Ethereum 上的 USDC,标准档也支持 Stripe 卡支付。需要具备支付能力的客户端钱包;README 的 LangChain 示例使用 EVM 私钥环境变量。
安装前请注意
每次调用都产生费用:标准解析器每次 0.002 USDC,隐身解析器每次 0.05 USDC,标准档卡支付最低 0.50 美元。支付签名可能需要私钥或钱包凭据,建议使用专用的低余额钱包。隐身档使用代理轮换和可选验证码破解,可能与网站条款冲突。抓取的网址会发送给第三方服务。

安装

在 SourceWeft 中

  1. 打开 控制台中的 NodeProxy Web Surface Markdown Parser,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.pgalyen1987%2Fnodeproxy/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "nodeproxy-web-surface-markdown-parser": {
      "type": "http",
      "url": "https://nodeproxy-production.up.railway.app/mcp"
    }
  }
}

README

NodeProxy

Self-discoverable MCP utility for autonomous agents — no ads, no landing page, no human in the loop.

NodeProxy exposes two paid tools:

ToolEndpointPriceUse case
surface_markdown_parserPOST /mcp/execute$0.002 USDCNormal public pages
stealth_markdown_parserPOST /stealth-scrape$0.05 USDCCloudflare/Akamai-protected sites

Both fetch a public URL, strip scripts/ads/nav noise, and return compressed Markdown optimized for LLM context windows. Standard tier also accepts Stripe MPP card payments ($0.50 minimum) alongside x402 USDC.

Agents find this service through MCP registries, x402 Bazaar discovery, and machine-readable manifests — not marketing.

Why agents need this

Heavy React/Vue sites burn tokens when agents ingest raw HTML. NodeProxy returns clean Markdown so autonomous retrieval loops stay cheap and accurate. When basic fetch hits bot walls, the stealth tier escalates with proxy rotation, hardened Playwright, and optional CAPTCHA solving.

Architecture

Autonomous Agent    │  search MCP registry / Bazaar (vector or keyword)    ▼GET /mcp/tools  or  MCP list_tools    │  reads JSON schema ("Machine UI")    ▼POST /mcp/execute  or  POST /stealth-scrape    │  no payment → 402 + PAYMENT-REQUIRED (+ Bazaar extension)    │  x402 PAYMENT-SIGNATURE or MPP Authorization: Payment …    │  facilitator verify/settle → parse URL    ▼Markdown payload → agent continues task

Quick start

bash
cd NodeProxycp .env.example .env# Set WALLET_ADDRESS to your Base walletnpm installnpm run dev

Endpoints (replace host with your deploy URL):

EndpointPurpose
GET /healthService status, pricing, stealth/MPP config
GET /mcp/toolsTool catalog for registry crawlers
POST /mcp/executeStandard parse + x402/MPP gate
POST /stealth-scrapeStealth parse + x402 gate
ALL /mcpStreamable HTTP MCP transport
GET /.well-known/mcp.jsonWell-known MCP discovery
GET /.well-known/x402.jsonx402 + Bazaar discovery manifest
GET /.well-known/mpp.jsonMPP Stripe manifest (when configured)
GET /discovery/agent.jsonAgent discovery card
GET /registry/server.jsonLive registry manifest (dynamic)

Environment

VariableDefaultDescription
WALLET_ADDRESS—USDC recipient (your revenue)
PRICE_USDC0.002Standard tier price per parse
STEALTH_PRICE_USDC0.05Stealth tier price per parse
X402_NETWORKeip155:84532Primary network; use eip155:8453 on mainnet
X402_NETWORKSCDP bundleComma-separated CAIP-2 ids (Base, Polygon, Arbitrum, optional Ethereum L1)
FACILITATOR_URLhttps://x402.org/facilitatorx402 facilitator
CDP_API_KEY_ID / CDP_API_KEY_SECRET—Coinbase CDP facilitator (mainnet)
MPP_SECRET_KEY / STRIPE_SECRET_KEY—Stripe MPP on /mcp/execute
STEALTH_PROXY_URLS—Comma-separated proxy URLs for stealth tier
CAPTCHA_SOLVER_KEY—2captcha API key (optional)
PUBLIC_URLlocalhostUsed in discovery manifests

Machine discovery (zero advertising)

  1. Deploy to Railway or any HTTPS host.
  2. Verify live manifests: /mcp/tools, /.well-known/x402.json, /registry/server.json.
  3. Submit PR to the open-source MCP Registry using integrations/mcp-registry/server-entry.json.
  4. Bazaar auto-index: after successful x402 settlements through a Bazaar-enabled facilitator, tools appear in the global Bazaar index (Bazaar docs). NodeProxy attaches Bazaar extension metadata on every 402 response.
  5. Enterprise hubs (Google Agent Registry, Anthropic routing): point them at /.well-known/mcp.json or /discovery/agent.json.

Tool descriptions are written for LLM tool-matching, not humans.

Payment rails

RailToolsDestinationAmount
x402 USDCStandard + stealthYour WALLET_ADDRESS$0.002 / $0.05
Stripe MPPStandard onlyStripe account balance$0.50/card (SPT minimum)

MCP stdio (Claude Desktop / local agents)

bash
npm run mcp:stdio

Add to Claude Desktop config:

json
{  "mcpServers": {    "nodeproxy": {      "command": "node",      "args": ["--import", "tsx", "/path/to/NodeProxy/src/mcp/stdio.ts"],      "env": { "WALLET_ADDRESS": "0x..." }    }  }}

HTTP execute example

bash
# Stage A — get 402 challenge (includes Bazaar extension in PAYMENT-REQUIRED)curl -i "http://localhost:4022/mcp/execute" \  -H 'Content-Type: application/json' \  -d '{"arguments":{"url":"https://example.com"}}'
# Stage B — retry with PAYMENT-SIGNATURE from x402 client walletcurl "http://localhost:4022/mcp/execute" \  -H 'Content-Type: application/json' \  -H 'PAYMENT-SIGNATURE: <base64>' \  -d '{"arguments":{"url":"https://example.com"}}'
# Stealth tier (x402 only)curl -i "http://localhost:4022/stealth-scrape" \  -H 'Content-Type: application/json' \  -d '{"arguments":{"url":"https://example.com"}}'

Use @x402/fetch, @x402/mcp, or nodeproxy-tools for automatic payment.

Deploy on Railway

Railway is the recommended host: full Node.js (JSDOM works), no 15s serverless timeout, metered billing when idle.

1. Push to GitHub

bash
cd NodeProxygit init && git add . && git commit -m "NodeProxy MCP x402 parser"git remote add origin https://github.com/YOU/nodeproxy.gitgit push -u origin main

2. Create Railway project

  1. Go to railway.app → New Project → Deploy from GitHub repo
  2. Select your repo — Railway reads railway.toml + nixpacks.toml automatically
  3. Settings → Networking → Generate Domain (gives you *.up.railway.app)

3. Set environment variables

In Railway → Variables:

VariableValue
WALLET_ADDRESSYour Base wallet (USDC recipient)
X402_NETWORKeip155:8453
PRICE_USDC0.002
STEALTH_PRICE_USDC0.05
CDP_API_KEY_ID / CDP_API_KEY_SECRETCoinbase CDP keys (mainnet facilitator)
MPP_SECRET_KEY / STRIPE_SECRET_KEYStripe MPP (optional)
HOST0.0.0.0
MAX_CONCURRENT_PARSES20
RATE_LIMIT_PER_MINUTE120

You do not need to set PORT or PUBLIC_URL — Railway injects PORT, and the app auto-detects RAILWAY_PUBLIC_DOMAIN for discovery manifests.

4. Verify deploy

bash
curl https://YOUR-APP.up.railway.app/healthcurl https://YOUR-APP.up.railway.app/mcp/toolscurl https://YOUR-APP.up.railway.app/.well-known/x402.json

5. Register for agent discovery

Open a PR to the MCP Registry with integrations/mcp-registry/server-entry.json. Agents hit:

  • https://YOUR-APP.up.railway.app/mcp/tools
  • https://YOUR-APP.up.railway.app/.well-known/mcp.json
  • https://YOUR-APP.up.railway.app/.well-known/x402.json

Cost expectation

Railway’s free tier gives $1/month credit after trial — enough for low traffic ($0.30–0.50/mo idle). One paid agent call at $0.002 USDC covers that. Scale to Hobby ($5/mo) when bot traffic grows.

Do not use Vercel/Cloudflare Workers for this service — JSDOM and 25s fetch timeouts exceed edge limits.

Production (Base mainnet)

env
X402_NETWORK=eip155:8453WALLET_ADDRESS=0xYourWalletPRICE_USDC=0.002STEALTH_PRICE_USDC=0.05

USDC on Base: 0x833589fcd6edb6e08f4c7c32d4f71b54bda02913

Upstream framework integrations

To get NodeProxy baked into LangChain, CrewAI, and MCP registry discovery:

  • integrations/UPSTREAM.md — fork → PR → merge playbook
  • integrations/python/ — nodeproxy-tools PyPI package + LangChain/CrewAI wrappers
  • integrations/typescript/ — @nodeproxy/langchain npm package
  • integrations/mcp-registry/ — MCP registry PR template

Quick LangChain example:

python
pip install "nodeproxy-tools[x402,langchain]"export EVM_PRIVATE_KEY=0x...
from nodeproxy_tools.langchain import NodeProxyMarkdownTooltool = NodeProxyMarkdownTool()markdown = tool.invoke({"url": "https://example.com"})

Naming

NodeProxy is registry-ready: boring, predictable, and reads as infrastructure. Tool names (surface_markdown_parser, stealth_markdown_parser) are chosen so semantic search hits match intent.

License

MIT

Part of Gate402

This service is part of the Gate402 x402 agent-API suite — pay-per-call APIs for AI agents over HTTP 402 (USDC on Base). Use it standalone, through the unified storefront + CDP x402 Bazaar at gate402.app, or as an MCP server: npx -y gate402-mcp.

来源:README.md,提交 d28f737

工具

2

surface_markdown_parser

Web Surface Markdown Parser

Executes fetch on any public URL, strips scripts/ads/nav noise, and returns compressed semantic Markdown optimized for LLM token ingestion. Price: $0.002 USDC per call.

输入参数url必填

stealth_markdown_parser

Stealth Anti-Bot Markdown Parser

Hardened headless-browser fetch with full JavaScript/SPA rendering and a realistic browser profile, returning fully rendered Markdown. Best for JavaScript-heavy/SPA pages and light bot checks; not guaranteed against advanced anti-bot walls (e.g. Cloudflare/Akamai). Price: $0.05 USDC per call.

输入参数url必填

版本历史

1
  1. v1.1.2最新Sep 16, 2026

评分

已满足适用检查项的 90%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分

    请在仓库或注册中心条目中声明许可证。

其他 Parser 集成