Web Search & Scraping MCP Servers
Search, news retrieval, crawling, scraping, extraction, and public web collection.
Licence audit, page read and endpoint check (AI-operated)
dev.workers.rjhsignaltech.ai
A remote, AI-operated server offering free previews of licence audits, page reads and endpoint checks, with paid full versions over x402.
Skim
dev.workers.perch-app.skimOfficial publisher
Lets an assistant fetch web pages as clean Markdown or structured data, including normalized job listings.
Robots.txt Policy Lint
dev.workers.pathwren.wwwOfficial publisher
Lets an assistant lint, test, compare and merge robots.txt policies, including checks against AI crawlers, without any account or API key.
Crawler IP Verifier - real Googlebot or fake
dev.workers.pathwren.wwwOfficial publisher
A remote, keyless MCP endpoint that checks IP addresses against mirrored crawler-operator prefix lists to tell real Googlebot-style crawlers from fakes.
AI Crawler Index
dev.workers.pathwren.wwwOfficial publisher
Read-only index of web crawlers and AI bots: lets an assistant identify user agents, check crawler IPs, and draft robots.txt rules.
Agent Discovery Doctor - llms.txt, agent card, mcp.json
dev.workers.pathwren.wwwOfficial publisher
A free, read-only remote MCP server that checks a host's agent-discovery documents (llms.txt, agent card, mcp.json) and validates pasted ones.
Web Access Gateway
dev.workers.mattskowronis.web-access-gatewayOfficial publisher
A remote paid gateway that lets an assistant run web, news, company, product and geographic searches and read clean page content.
Source Claim Proof
dev.workers.mattskowronis.source-claim-proofOfficial publisher
Lets an assistant check one atomic factual claim against one public source URL and get a supported, contradicted, or insufficient-evidence verdict.
SEC Filing Proof
dev.workers.mattskowronis.sec-filing-proofOfficial publisher
A remote MCP server that checks whether a company's official SEC filing supports a specific financial claim, returning filing and XBRL evidence.
Live Listing Proof
dev.workers.mattskowronis.live-listing-proofOfficial publisher
A remote MCP server that checks a public product, marketplace, auction or classified listing URL and returns source-supported facts or an explicit failure state
Krabbot Devtools
dev.workers.marvin-odigo.mcpOfficial publisher
A remote MCP server giving assistants pre-install package risk checks, stack end-of-life and CVE checks, scored open-source bounties, and US regulatory deadline
LION - keyless x402 data + RPC for agents
dev.workers.lionmaster-operations.lion-x402Official publisher
Lets an assistant buy sanctions screening, company research, on-chain data and web search results through x402 payments.
Ghost X402 Market Intel Vet Schema
dev.workers.ghost-agent-os.ghost-identityOfficial publisher
Lets an assistant run web searches for a single x402 payment and vet or gate x402 and API providers before paying them.
ATProto Data Layer
dev.workers.filae.atproto-mcpOfficial publisher
A remote MCP server that lets an assistant search ATProto content — writing, annotations, identity, agents and forum posts — through 12 read-only tools.
Plainport
dev.workers.exportitnow.plainportOfficial publisher
A remote MCP endpoint offering deterministic web intake and data utility tools for autonomous agents.
x402 economy tools
dev.workers.clankerceo.multichain-rpcOfficial publisher
A remote MCP server that gives an assistant measured data on the x402 payment ecosystem, including merchant verification, facilitator reliability and endpoint l
WebLens
dev.weblensOfficial publisher
WebLens is a paid, pay-per-call web scraping and search service that lets an assistant fetch, crawl, search and extract web content without an account or API…
Webanalyzer
dev.webanalyzerOfficial publisher
Remote MCP server that scores any public web page 0-100 across eight quality dimensions and returns issues, grades and a public leaderboard.
VibeSEO
dev.vibeseoOfficial publisher
Remote OAuth-secured SEO server that lets an assistant run keyword research, domain analysis, site audits, Search Console reports, backlinks and content…
Vantage
dev.vantagemcpOfficial publisher
Vantage checks whether ChatGPT, Gemini and Perplexity cite a domain for given questions, shows who is cited instead, and returns a fix brief for the page.
Urlsnap Mcp
dev.urlsnap
Local MCP server that lets an assistant capture screenshots, PDFs and markdown extractions from any URL via the URLSnap API.
Urantia Papers
dev.urantiaOfficial publisher
Remote MCP server for the Urantia Papers: browse, search and cite its 197 papers, with cross-references to the Bible and 21 other texts.
True402
dev.true402
Local MCP server that gives an assistant pay-per-call access to LLM inference, web/SEO tools and on-chain token safety checks, paid in USDC on Base via x402.
TubeScribe API
dev.transcriptapi
Lets an assistant fetch YouTube transcripts, metadata, timestamps, and AI summaries for videos.