AgentScrape

io.github.hshintelligence由 GitHub 账号 hshintelligence 发布v0.6.1更新于 Oct 24, 2026

Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup.

发布方自己的服务：Scrape.ly

已验证Streamable HTTP可网页运行网页搜索与抓取浏览器自动化

概览

AI 生成的概览

远程 MCP 服务器，可抓取网页、提取结构化数据与元数据、截图并执行浏览器工作流，按次以 USDC 付费。

可以做什么
  • 将网页抓取为 markdown、HTML、文本或 JSON
  • 用自然语言提示或 schema 从页面提取结构化 JSON
  • 截取 PNG 截图，支持桌面、手机、平板视口及整页模式
  • 提取页面元数据：标题、描述、Open Graph、Twitter 卡片、JSON-LD 与规范链接
  • 创建保留 cookie 与 localStorage 的有状态浏览器会话
  • 执行最多 20 步的多步浏览器工作流（导航、点击、输入、等待、滚动、截图、提取、执行脚本）
适用场景
适合需要实时网页内容、结构化提取或截图、又不想自建抓取体系的助手，且客户端能通过加密钱包完成 x402 支付。也适合无法注册账号或管理 API 密钥的自主代理。
运行要求
远程 Streamable HTTP 端点，无需注册或 API 密钥。每次工具调用需通过 x402 协议以 Base 主网 USDC 付费，因此 MCP 客户端需具备兼容 x402 的钱包。每钱包每 30 天 10 次的免费额度仅适用于 HTTP API，不适用于 MCP 调用。
安装前请注意
每次 MCP 工具调用都会从钱包扣除 USDC，价格在启动窗口期标为 0.001 美元，之后上调。支付由客户端处理，钱包凭据与支出限额由用户自行掌握。抓取的网址与页面内容会发送给运营方及第三方服务（Cloudflare Browser Rendering、Groq）处理。

安装

在 SourceWeft 中

  1. 打开 控制台中的 AgentScrape，将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable，通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体，或 SourceWeft 对话中。智能体会读取该服务器的安装指南，先向你展示发布者、端点和登录方式，经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.hshintelligence%2Fagent-scrape/install.md，并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前，先告诉我它的发布者、端点和登录方式，等我确认。不要把 API 密钥写进命令或我会提交的文件；问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "agentscrape": {
      "type": "http",
      "url": "https://agent-scrape.healingsunhaven.workers.dev/mcp"
    }
  }
}

README

AgentScrape

Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC.

[x402] [MCP] [Base] [Cloudflare Workers] [License: MIT] [hshintelligence/agent-scrape MCP server]

Live: agent-scrape.healingsunhaven.workers.dev

AI agents discover AgentScrape, pay per call in USDC on Base, and get clean structured data back — no accounts, no API keys, no human in the loop.

Two protocols, one service:

  • HTTP API with x402 v2 payment gate — for agents using raw HTTP
  • MCP server (Streamable HTTP transport) — for Claude Desktop, Cursor, Continue.dev, and any MCP-compatible framework

Why this exists

Traditional scraping APIs assume a human:

  • Sign up with email
  • Add a payment method
  • Manage an API key
  • Commit to a monthly subscription

AI agents can't do any of that. They have wallets. They have stablecoins. They need infrastructure built for them.

AgentScrape speaks two open standards:

  • x402 — HTTP-native payment protocol. The server returns 402 with payment requirements; the agent signs a USDC transfer; the facilitator settles on-chain; the data flows back. End-to-end in under 2 seconds.
  • MCP — the standard agent tool interface. Agents browse, discover, and invoke tools without per-vendor SDKs.

No signup. No API keys. No subscription. Just USDC.

Tools

All tools cost $0.001 USDC during the mainnet validation window. Pricing ramps after stability is proven (see Pricing).

ToolDescription
scrape_webpageScrape any URL to markdown, HTML, text, or JSON
extract_structured_dataAI-powered structured extraction with natural-language prompts and JSON schemas (Groq + Llama 4 Scout)
screenshot_webpagePNG screenshot with viewport control (desktop/mobile/tablet, optional full-page)
extract_metadataTitle, description, Open Graph, Twitter cards, JSON-LD, canonical URL
create_browser_sessionStateful browser session with cookie + localStorage persistence
run_workflowMulti-step atomic execution: navigate, click, type, wait, scroll, screenshot, extract, evaluate

Quick start — HTTP API

bash
# Free service discovery (no payment)curl https://agent-scrape.healingsunhaven.workers.dev/
# Paid call — without payment, returns 402 with payment requirementscurl -X POST https://agent-scrape.healingsunhaven.workers.dev/scrape \  -H "Content-Type: application/json" \  -d '{"url": "https://example.com", "format": "markdown"}'
# Free tier — first 10 calls per wallet, send your wallet in the X-402-Payer headercurl -X POST https://agent-scrape.healingsunhaven.workers.dev/scrape \  -H "Content-Type: application/json" \  -H "X-402-Payer: 0xYourBaseWalletAddress" \  -d '{"url": "https://example.com", "format": "markdown"}'

Quick start — MCP

Add to any MCP-compatible client via Streamable HTTP:

json
{  "mcpServers": {    "agent-scrape": {      "url": "https://agent-scrape.healingsunhaven.workers.dev/mcp",      "transport": "streamable-http"    }  }}

The x402 payment metadata is broadcast inside the MCP tools/list response. Your client handles the payment handshake automatically when configured with an x402-compatible wallet.

Discovery

For machine-driven discovery, four standard endpoints are exposed (free, no auth):

EndpointPurpose
/Service profile JSON (tools, prices, network, payTo)
/.well-known/x402 (and .json alias)x402 manifest — payTo, network, facilitator, all paid routes
/openapi.jsonOpenAPI 3.1 spec for traditional tooling
/llms.txtAgent-friendly plaintext description

The 402 response itself carries the canonical payment requirements in the base64-encoded Payment-Required header, and the body includes a human-readable error with discovery links.

Architecture

                ┌──────────────────────────────────┐                │      Cloudflare Workers          │                │      (global edge, 330+ POPs)    │                │                                  │AI Agent ───────┼─▶  GET  /                  (free)│(HTTP)          ├─▶  GET  /.well-known/x402  (free)│                ├─▶  GET  /openapi.json      (free)│                ├─▶  GET  /llms.txt          (free)│                ├─▶  POST /scrape         ($0.001) │                ├─▶  POST /extract        ($0.001) │                ├─▶  POST /screenshot     ($0.001) │                ├─▶  POST /metadata       ($0.001) │                ├─▶  POST /workflow       ($0.001) │                ├─▶  POST /session        ($0.001) │                │                                  │AI Agent ───────┼─▶  POST /mcp                     │(MCP)           │      • initialize                │                │      • tools/list                │                │      • tools/call (paid)         │                │                                  │                └──────────────┬───────────────────┘                               │              ┌────────────────┴─────────────────┐              │                                  │   Coinbase CDP facilitator       Browser Rendering API   (api.cdp.coinbase.com/         Groq API (Llama 4 Scout)    platform/v2/x402)             KV (sessions, free tier)   Ed25519 JWT auth   Settles USDC on Base              │              ▼   payTo wallet 0x3F33...9E9a

Stack:

  • Runtime: Cloudflare Workers (V8 isolates, global edge)
  • HTTP framework: Hono + @x402/hono v2 payment middleware
  • MCP framework: @modelcontextprotocol/sdk + agents/mcp with withX402 payment binding
  • Bazaar discovery: @x402/extensions — every paid route declares input schema + output example
  • Browser: Cloudflare Browser Rendering API + @cloudflare/puppeteer
  • AI extraction: Groq + Llama 4 Scout (17B, 16E)
  • Storage: Cloudflare KV (5-min response cache, browser sessions, free-tier counters)
  • Network: Base mainnet (eip155:8453)
  • Asset: Native USDC (0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913)
  • Facilitator: Coinbase CDP (api.cdp.coinbase.com/platform/v2/x402) with Ed25519 JWT auth

Free tier

Every wallet address gets 10 free calls per 30 days on the HTTP API. Pass your Base wallet in the X-402-Payer header. After 10 calls, payment via x402 is required.

Free tier is HTTP-only. MCP calls go through the standard x402 payment flow.

Pricing

Launch window (first 48h on mainnet): $0.001 flat per tool call.

After validation, pricing ramps to:

ToolProduction price
scrape_webpage$0.003
extract_structured_data$0.005
screenshot_webpage$0.003
extract_metadata$0.002
run_workflow$0.008
create_browser_session$0.001

Bulk discounts (20% at 1K calls/month, 40% at 10K) are planned.

Why x402 + MCP

Traditional APIx402 + MCP
Sign up at scraperapi.comDiscover via MCP initialize
Add credit cardWallet holds USDC
Get API keyNo keys
$49/month minimum$0.001 per call
Manage rate limitsPay-per-use, no limits
Human in the loopAgent fully autonomous

Verifying the deployment

bash
# Service identitycurl https://agent-scrape.healingsunhaven.workers.dev/ | jq .
# x402 manifestcurl https://agent-scrape.healingsunhaven.workers.dev/.well-known/x402 | jq .
# 402 challenge with x402 v2 headerscurl -i -X POST https://agent-scrape.healingsunhaven.workers.dev/scrape \  -H "Content-Type: application/json" \  -d '{"url":"https://example.com"}'# → HTTP 402, Payment-Required header (base64 JSON), Cache-Control: private, no-store
# CORS preflight (browser-based agents)curl -i -X OPTIONS https://agent-scrape.healingsunhaven.workers.dev/scrape \  -H "Origin: https://example.com" \  -H "Access-Control-Request-Method: POST" \  -H "Access-Control-Request-Headers: Content-Type,X-Payment"# → HTTP 204, allow-headers includes X-Payment and Payment-Signature

Roadmap

Q3 2026:

  • AgentParse — document/PDF/OCR-to-markdown service (same x402 + MCP pattern)
  • AgentSearch — multi-backend web search aggregation
  • LangChain integration package (langchain-agent-scrape)

Q4 2026:

  • Subscription bundles (1000 scrapes for $2.50)
  • Multi-asset support (USDT on Base, USDC on Arbitrum)
  • Webhook + async response option for long-running workflows

Run locally

Requires Node 22+, a Cloudflare account with Workers + Browser Rendering enabled, a Groq API key, and a Coinbase CDP API key.

bash
git clone https://github.com/hshintelligence/agent-scrape.gitcd agent-scrapenpm install
# Set secretsnpx wrangler secret put GROQ_API_KEYnpx wrangler secret put CDP_API_KEY_IDnpx wrangler secret put CDP_API_KEY_SECRET
# Local devnpx wrangler dev
# Deploynpx wrangler deploy

To use your own wallet as payTo, edit the PAY_TO constant in src/index.ts.

License

MIT — see LICENSE.

Contact

Built by HSH Intelligence, operated by Healing Sun Haven LLC (Wyoming, USA).

Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC.

Using AgentScrape from ElizaOS

ElizaOS supports remote MCP servers natively via the @elizaos/plugin-mcp plugin. AgentScrape works out of the box — no custom integration needed.

Install the MCP plugin

bash
bun add @elizaos/plugin-mcp# ornpm install @elizaos/plugin-mcp

Configure your character to use AgentScrape

In your ElizaOS character JSON, add the plugin and point the MCP server config at AgentScrape's Streamable HTTP endpoint:

json
{  "name": "ResearchAgent",  "plugins": ["@elizaos/plugin-mcp"],  "settings": {    "mcp": {      "servers": {        "agentscrape": {          "type": "streamable-http",          "name": "AgentScrape",          "url": "https://agent-scrape.healingsunhaven.workers.dev/mcp",          "timeout": 60        }      }    }  }}

Available tools (auto-discovered by ElizaOS)

Once configured, the agent automatically discovers all six AgentScrape tools:

ToolCostPurpose
scrape_webpage$0.003 USDCMarkdown/HTML/text/JSON scrape
extract_structured_data$0.005 USDCAI extraction via Groq + Llama 4 Scout
screenshot_webpage$0.003 USDCPNG screenshot with viewport control
extract_metadata$0.002 USDCTitle, OG, Twitter, JSON-LD
create_browser_session$0.001 USDCStateful browser session
run_workflow$0.008 USDCMulti-step atomic workflow up to 20 steps

Free tier

The first 10 calls per wallet in the first 30 days are free. After that, calls are paid in USDC on Base mainnet (eip155:8453) via the x402 v2 payment protocol. To pay, supply the X-PAYMENT-RESPONSE header with an x402 payment receipt on retry — the standard x402 flow.

Example prompt

Once the plugin is wired up, your ElizaOS agent can use AgentScrape transparently:

User: "Scrape https://www.x402.org and give me a two-sentence summary."

ElizaOS routes the request through @elizaos/plugin-mcp, which calls AgentScrape's scrape_webpage tool, and the agent answers based on the live page content.

Resources

来源：README.md，提交 2636125

工具

6

scrape_webpage

Scrape Webpage

Scrape any webpage and return content as markdown, html, text, or json. Pay-per-call web scraping for AI agents.

输入参数url必填formatwait_msviewportwait_for

extract_structured_data

Extract Structured Data

AI-powered structured data extraction from any webpage using natural language. Returns JSON matching your prompt or schema.

输入参数url必填prompt必填schemawait_mswait_for

screenshot_webpage

Screenshot Webpage

Capture a PNG screenshot of any webpage. Supports desktop, mobile, and tablet viewports, plus full-page mode.

输入参数url必填wait_msviewportwait_forfull_page

extract_metadata

Extract Page Metadata

Extract page metadata: title, description, Open Graph, Twitter cards, JSON-LD, canonical URL, and all meta tags.

输入参数url必填

create_browser_session

Create Browser Session

Create a stateful browser session that persists cookies and localStorage across multiple scrape/workflow calls.

输入参数ttl_seconds

run_workflow

Run Browser Workflow

Execute a multi-step browser workflow atomically: navigate, click, type, wait, scroll, screenshot, extract, evaluate. Up to 20 steps.

输入参数steps必填viewportsession_idpersist_session

版本历史

1
  1. v0.6.1最新Sep 16, 2026

评分

已满足适用检查项的 100%

该评分衡量此收录条目的完整程度，依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价，也不表示服务器安全或当前可用：可连通性是带日期的检查结果，评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分

其他 Scrape 集成

Scrape.ly

ly.scrape官方发布者

Scrape.ly 的 MCP 服务器，让助手在 Scrape.ly 商店中搜索 Actor、运行它们，并读取其数据集、键值存储和日志。

Streamable HTTP可网页运行鉴权
网页搜索与抓取需要凭据Nov 7, 2026

SEO Data MCP (SteadyScrape)

由 GitHub 账号 steadyscrape 发布

关键词搜索量、实时SERP排名、域名流量、排名关键词、反向链接、Google Trends、YouTube。AI 翻译

Streamable HTTP可网页运行鉴权
网页搜索与抓取需要凭据Nov 3, 2026

x402-scrape-mcp

由 GitHub 账号 6mickswagger9 发布

本地 MCP 服务器，为 AI 代理提供 x402 付费 API，通过 CDP facilitator 以 Base 上的 USDC 结算。

STDIO仅桌面
网页搜索与抓取未验证 · 服务器未能启动Oct 31, 2026

TrueScrape

由 GitHub 账号 TrueScrape 发布

付费 API，让助手获取 52 个平台的公开实时数据——社交账号与帖子、商品列表、房产与广告数据，并支持提及监控。

Streamable HTTP可网页运行鉴权
网页搜索与抓取200+ 个工具Nov 4, 2026

Jobs Data MCP (SteadyScrape)

由 GitHub 账号 steadyscrape 发布

由 Apify 托管的远程 MCP 服务器，让助手获取来自 14 个以上 ATS 招聘网站及远程岗位的实时招聘信息。

Streamable HTTP可网页运行鉴权
网页搜索与抓取需要凭据Nov 6, 2026