NodeProxy Web Surface Markdown Parser

io.github.pgalyen1987由 GitHub 帳號 pgalyen1987 發布v1.1.2更新於 Oct 25, 2026

x402 MCP web parser: URLs to Markdown for agents. USDC on Base, Polygon, Arbitrum, Ethereum.

發布方自己的服務:Parser Club

已驗證Streamable HTTP可網頁執行網頁搜尋與抓取瀏覽器自動化

概覽

AI 產生的概覽

付費的網頁轉 Markdown 解析 MCP 伺服器,抓取公開網址並回傳乾淨、壓縮的 Markdown 供助理使用。

可以做什麼
抓取公開網址並回傳壓縮的語意 Markdown,去除腳本、廣告與導覽雜訊,適用於一般頁面,依呼叫次數低價計費。透過強化的無頭瀏覽器與擬真瀏覽器設定抓取 JavaScript 密集或 SPA 頁面,回傳完整渲染的 Markdown,依呼叫次數高價計費。兩個層級都旨在讓內容繁重的網站擷取流程更節省 token。
適用情境
當助理需要可讀的網頁內容而非原始 HTML 時適用,尤其是會大量消耗上下文的 React 或 Vue 網站,或基本抓取被輕度反機器人機制阻擋、需要渲染版本時。
執行需求
可作為遠端 streamable HTTP 端點執行,也可透過 nodeproxy-tools(PyPI)或 @nodeproxy/langchain(npm)套件以 stdio 在本機執行。呼叫需付費:透過 x402 使用 Base、Polygon、Arbitrum 或 Ethereum 上的 USDC,標準層級也支援 Stripe 信用卡付款。需要具備付款能力的用戶端錢包;README 的 LangChain 範例使用 EVM 私鑰環境變數。
安裝前請注意
每次呼叫都會產生費用:標準解析器每次 0.002 USDC,隱匿解析器每次 0.05 USDC,標準層級信用卡付款最低 0.50 美元。付款簽章可能需要私鑰或錢包憑證,建議使用專用的低餘額錢包。隱匿層級使用代理輪換與選用驗證碼破解,可能與網站條款衝突。抓取的網址會傳送給第三方服務。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 NodeProxy Web Surface Markdown Parser,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Web executable,透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

交給代理程式安裝

把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式,或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南,先向你展示發布者、端點和登入方式,經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。

閱讀 https://sourceweft.com/mcp/io.github.pgalyen1987%2Fnodeproxy/install.md,並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前,先告訴我它的發布者、端點和登入方式,等我確認。不要把 API 金鑰寫進命令或我會提交的檔案;問我金鑰應從哪裡取得。

檢視代理程式所依據的安裝指南

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。

{
  "mcpServers": {
    "nodeproxy-web-surface-markdown-parser": {
      "type": "http",
      "url": "https://nodeproxy-production.up.railway.app/mcp"
    }
  }
}

README

NodeProxy

Self-discoverable MCP utility for autonomous agents — no ads, no landing page, no human in the loop.

NodeProxy exposes two paid tools:

ToolEndpointPriceUse case
surface_markdown_parserPOST /mcp/execute$0.002 USDCNormal public pages
stealth_markdown_parserPOST /stealth-scrape$0.05 USDCCloudflare/Akamai-protected sites

Both fetch a public URL, strip scripts/ads/nav noise, and return compressed Markdown optimized for LLM context windows. Standard tier also accepts Stripe MPP card payments ($0.50 minimum) alongside x402 USDC.

Agents find this service through MCP registries, x402 Bazaar discovery, and machine-readable manifests — not marketing.

Why agents need this

Heavy React/Vue sites burn tokens when agents ingest raw HTML. NodeProxy returns clean Markdown so autonomous retrieval loops stay cheap and accurate. When basic fetch hits bot walls, the stealth tier escalates with proxy rotation, hardened Playwright, and optional CAPTCHA solving.

Architecture

Autonomous Agent    │  search MCP registry / Bazaar (vector or keyword)    ▼GET /mcp/tools  or  MCP list_tools    │  reads JSON schema ("Machine UI")    ▼POST /mcp/execute  or  POST /stealth-scrape    │  no payment → 402 + PAYMENT-REQUIRED (+ Bazaar extension)    │  x402 PAYMENT-SIGNATURE or MPP Authorization: Payment …    │  facilitator verify/settle → parse URL    ▼Markdown payload → agent continues task

Quick start

bash
cd NodeProxycp .env.example .env# Set WALLET_ADDRESS to your Base walletnpm installnpm run dev

Endpoints (replace host with your deploy URL):

EndpointPurpose
GET /healthService status, pricing, stealth/MPP config
GET /mcp/toolsTool catalog for registry crawlers
POST /mcp/executeStandard parse + x402/MPP gate
POST /stealth-scrapeStealth parse + x402 gate
ALL /mcpStreamable HTTP MCP transport
GET /.well-known/mcp.jsonWell-known MCP discovery
GET /.well-known/x402.jsonx402 + Bazaar discovery manifest
GET /.well-known/mpp.jsonMPP Stripe manifest (when configured)
GET /discovery/agent.jsonAgent discovery card
GET /registry/server.jsonLive registry manifest (dynamic)

Environment

VariableDefaultDescription
WALLET_ADDRESS—USDC recipient (your revenue)
PRICE_USDC0.002Standard tier price per parse
STEALTH_PRICE_USDC0.05Stealth tier price per parse
X402_NETWORKeip155:84532Primary network; use eip155:8453 on mainnet
X402_NETWORKSCDP bundleComma-separated CAIP-2 ids (Base, Polygon, Arbitrum, optional Ethereum L1)
FACILITATOR_URLhttps://x402.org/facilitatorx402 facilitator
CDP_API_KEY_ID / CDP_API_KEY_SECRET—Coinbase CDP facilitator (mainnet)
MPP_SECRET_KEY / STRIPE_SECRET_KEY—Stripe MPP on /mcp/execute
STEALTH_PROXY_URLS—Comma-separated proxy URLs for stealth tier
CAPTCHA_SOLVER_KEY—2captcha API key (optional)
PUBLIC_URLlocalhostUsed in discovery manifests

Machine discovery (zero advertising)

  1. Deploy to Railway or any HTTPS host.
  2. Verify live manifests: /mcp/tools, /.well-known/x402.json, /registry/server.json.
  3. Submit PR to the open-source MCP Registry using integrations/mcp-registry/server-entry.json.
  4. Bazaar auto-index: after successful x402 settlements through a Bazaar-enabled facilitator, tools appear in the global Bazaar index (Bazaar docs). NodeProxy attaches Bazaar extension metadata on every 402 response.
  5. Enterprise hubs (Google Agent Registry, Anthropic routing): point them at /.well-known/mcp.json or /discovery/agent.json.

Tool descriptions are written for LLM tool-matching, not humans.

Payment rails

RailToolsDestinationAmount
x402 USDCStandard + stealthYour WALLET_ADDRESS$0.002 / $0.05
Stripe MPPStandard onlyStripe account balance$0.50/card (SPT minimum)

MCP stdio (Claude Desktop / local agents)

bash
npm run mcp:stdio

Add to Claude Desktop config:

json
{  "mcpServers": {    "nodeproxy": {      "command": "node",      "args": ["--import", "tsx", "/path/to/NodeProxy/src/mcp/stdio.ts"],      "env": { "WALLET_ADDRESS": "0x..." }    }  }}

HTTP execute example

bash
# Stage A — get 402 challenge (includes Bazaar extension in PAYMENT-REQUIRED)curl -i "http://localhost:4022/mcp/execute" \  -H 'Content-Type: application/json' \  -d '{"arguments":{"url":"https://example.com"}}'
# Stage B — retry with PAYMENT-SIGNATURE from x402 client walletcurl "http://localhost:4022/mcp/execute" \  -H 'Content-Type: application/json' \  -H 'PAYMENT-SIGNATURE: <base64>' \  -d '{"arguments":{"url":"https://example.com"}}'
# Stealth tier (x402 only)curl -i "http://localhost:4022/stealth-scrape" \  -H 'Content-Type: application/json' \  -d '{"arguments":{"url":"https://example.com"}}'

Use @x402/fetch, @x402/mcp, or nodeproxy-tools for automatic payment.

Deploy on Railway

Railway is the recommended host: full Node.js (JSDOM works), no 15s serverless timeout, metered billing when idle.

1. Push to GitHub

bash
cd NodeProxygit init && git add . && git commit -m "NodeProxy MCP x402 parser"git remote add origin https://github.com/YOU/nodeproxy.gitgit push -u origin main

2. Create Railway project

  1. Go to railway.app → New Project → Deploy from GitHub repo
  2. Select your repo — Railway reads railway.toml + nixpacks.toml automatically
  3. Settings → Networking → Generate Domain (gives you *.up.railway.app)

3. Set environment variables

In Railway → Variables:

VariableValue
WALLET_ADDRESSYour Base wallet (USDC recipient)
X402_NETWORKeip155:8453
PRICE_USDC0.002
STEALTH_PRICE_USDC0.05
CDP_API_KEY_ID / CDP_API_KEY_SECRETCoinbase CDP keys (mainnet facilitator)
MPP_SECRET_KEY / STRIPE_SECRET_KEYStripe MPP (optional)
HOST0.0.0.0
MAX_CONCURRENT_PARSES20
RATE_LIMIT_PER_MINUTE120

You do not need to set PORT or PUBLIC_URL — Railway injects PORT, and the app auto-detects RAILWAY_PUBLIC_DOMAIN for discovery manifests.

4. Verify deploy

bash
curl https://YOUR-APP.up.railway.app/healthcurl https://YOUR-APP.up.railway.app/mcp/toolscurl https://YOUR-APP.up.railway.app/.well-known/x402.json

5. Register for agent discovery

Open a PR to the MCP Registry with integrations/mcp-registry/server-entry.json. Agents hit:

  • https://YOUR-APP.up.railway.app/mcp/tools
  • https://YOUR-APP.up.railway.app/.well-known/mcp.json
  • https://YOUR-APP.up.railway.app/.well-known/x402.json

Cost expectation

Railway’s free tier gives $1/month credit after trial — enough for low traffic ($0.30–0.50/mo idle). One paid agent call at $0.002 USDC covers that. Scale to Hobby ($5/mo) when bot traffic grows.

Do not use Vercel/Cloudflare Workers for this service — JSDOM and 25s fetch timeouts exceed edge limits.

Production (Base mainnet)

env
X402_NETWORK=eip155:8453WALLET_ADDRESS=0xYourWalletPRICE_USDC=0.002STEALTH_PRICE_USDC=0.05

USDC on Base: 0x833589fcd6edb6e08f4c7c32d4f71b54bda02913

Upstream framework integrations

To get NodeProxy baked into LangChain, CrewAI, and MCP registry discovery:

  • integrations/UPSTREAM.md — fork → PR → merge playbook
  • integrations/python/ — nodeproxy-tools PyPI package + LangChain/CrewAI wrappers
  • integrations/typescript/ — @nodeproxy/langchain npm package
  • integrations/mcp-registry/ — MCP registry PR template

Quick LangChain example:

python
pip install "nodeproxy-tools[x402,langchain]"export EVM_PRIVATE_KEY=0x...
from nodeproxy_tools.langchain import NodeProxyMarkdownTooltool = NodeProxyMarkdownTool()markdown = tool.invoke({"url": "https://example.com"})

Naming

NodeProxy is registry-ready: boring, predictable, and reads as infrastructure. Tool names (surface_markdown_parser, stealth_markdown_parser) are chosen so semantic search hits match intent.

License

MIT

Part of Gate402

This service is part of the Gate402 x402 agent-API suite — pay-per-call APIs for AI agents over HTTP 402 (USDC on Base). Use it standalone, through the unified storefront + CDP x402 Bazaar at gate402.app, or as an MCP server: npx -y gate402-mcp.

來源:README.md,提交 d28f737

工具

2

surface_markdown_parser

Web Surface Markdown Parser

Executes fetch on any public URL, strips scripts/ads/nav noise, and returns compressed semantic Markdown optimized for LLM token ingestion. Price: $0.002 USDC per call.

輸入參數url必填

stealth_markdown_parser

Stealth Anti-Bot Markdown Parser

Hardened headless-browser fetch with full JavaScript/SPA rendering and a realistic browser profile, returning fully rendered Markdown. Best for JavaScript-heavy/SPA pages and light bot checks; not guaranteed against advanced anti-bot walls (e.g. Cloudflare/Akamai). Price: $0.05 USDC per call.

輸入參數url必填

版本歷史

1
  1. v1.1.2最新Sep 16, 2026

評分

已滿足適用檢查項的 90%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通必需25 分
  • 已宣告認證方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分

    請在儲存庫或註冊中心條目中宣告授權條款。

其他 Parser 整合