
X402 Scraper
io.github.ihen404Published by GitHub account ihen404v1.0.0Updated Oct 24, 2026
Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC.
Overview
A remote MCP endpoint for agent-driven web scraping that pays $0.02 USDC per request over the x402 protocol on Base, returning clean Markdown.
- What you can do
- Fetch a web page through an x402-paid scraping request and get back token-optimized Markdown with HTML and navigation boilerplate stripped.
- Discover and settle per-request payments in USDC on Base mid-task, without API keys.
- Queue scraping jobs through a decoupled worker setup intended to hold up under concurrency.
- Register or identify the agent on-chain via ERC-8004 identity on Base Mainnet or Base Sepolia.
- When to use it
- Use it when an agent needs to scrape pages without managing API keys or proxy subscriptions, and you are comfortable paying a flat per-request fee in USDC from a wallet. It suits autonomous agent workflows on Base rather than one-off manual fetching.
- Requirements
- A remote MCP endpoint (the manifest points at a placeholder domain, so a real deployment URL is needed). A funded crypto wallet with USDC on Base Mainnet or Base Sepolia, plus Coinbase AgentKit and LangChain packages if you follow the README's agent setup. Network access to the endpoint and the Base network.
Installation
In SourceWeft
- Open X402 Scraper in the dashboard and add it to a workspace.
- Enable the server for the chats that should use its tools.
Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.
Use with an agent
Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.
Read https://sourceweft.com/mcp/io.github.ihen404%2Fx402-scraper/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.Other MCP clients
Add this to your client's mcpServers config.
{
"mcpServers": {
"x402-scraper": {
"type": "http",
"url": "https://your-domain.com/mcp.json"
}
}
}README
@ihentrel/x402-scraper-langchain
[npm version] [License: MIT] [Network]
Protocol-native web scraping utility tool engineered for autonomous AI agents, powered by Coinbase AgentKit, LangChain, and x402 on-chain micro-settlements.
Key Features & Strategic Positioning
- Zero API Keys Required: Agents discover, pay, and execute scraping requests mid-task without unhandled API key exceptions or rate limits.
- Predictable Operational Cost: Flat $0.02 USDC/request settlement on Base, offering a transparent OpEx alternative to dynamic per-gigabyte proxy services.
- Token-Optimized Markdown: HTML, navigation boilerplate, and DOM elements are automatically stripped into clean, token-dense Markdown to reduce LLM context window costs.
- Asynchronous Queue Resilience: Underpinned by a decoupled
better-sqlite3queue andPM2worker mesh to prevent payload failures under high concurrency. - Ecosystem Ready: Native support for Model Context Protocol (MCP) manifests (
/mcp.json) and ERC-8004 identity registration on Base.
Quickstart
1. Installation
2. Basic Agent Usage
Model Context Protocol (MCP) Integration
For drop-in compatibility with MCP clients (e.g., Claude Desktop, Cursor, CrewAI):
On-Chain Verification
- Network: Base Mainnet / Base Sepolia
- Protocol Standard: ERC-8004 Agent Identity
- Settlement Asset: USDC ($0.02 / request)
License
MIT © Ike Ambrose Hentrel II
Source: README.md at commit c2a4a5b
Tools
0Version history
1- v1.0.0LatestSep 18, 2026
Score
75% of the applicable checks met
How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.
- Reached in the last 30 daysRequired25 pts
- Auth declaredRequired10 pts
- Tools listedRequired15 pts
Answer tools/list without a credential, or ship a package that starts in a sandbox without one.
- DescriptionRequired15 pts
- Logo10 pts
- Documentation15 pts
- License10 pts
Declare a license in the repository or the registry entry.