Scrapeunblocker Mcp Remote

com.scrapeunblocker由 scrapeunblocker.com 发布官方发布者v0.13.6更新于 Nov 5, 2026

Fetch any page's HTML or AI-parsed JSON, Google results, or 100+ site plugins via ScrapeUnblocker

已验证Streamable HTTP可网页运行位置与生活网页搜索与抓取商业与电商

概览

AI 生成的概览

托管的 ScrapeUnblocker MCP 服务器,让助手抓取被反爬拦截的网页、执行 Google 搜索,并通过 100 多个站点插件获取结构化数据。

可以做什么
  • 以渲染后的 HTML、干净的 Markdown 或 AI 解析的 JSON 抓取网页,绕过反爬保护
  • 执行 Google 搜索,返回 AI 概览、相关问题与相关搜索,并可一次调用搜索并阅读前几条结果
  • 先发现页面元素选择器,再用有序步骤(点击、输入、选择、滚动、等待)驱动真实浏览器
  • 列出并运行现成的站点插件,获取结构化 JSON
  • 使用 Amazon、Walmart、eBay、Google 购物、本地、图片、地图、YouTube、Zillow、Indeed、Trustpilot 和 Booking.com 的专用工具
适用场景
适用于普通抓取被验证码或 403/429 拦截时,需要 Google 搜索结果或商品、房源、职位、评价、旅行等结构化数据时,或希望以 Markdown 低成本读取网页时。
运行要求
远程 HTTP 端点,需要 ScrapeUnblocker 账号。可通过 OAuth 登录,或用 API 密钥认证:x-scrapeunblocker-key 请求头、Authorization Bearer 请求头,或 URL 中的密钥查询参数。列出工具无需凭据,实际运行工具则需要。
安装前请注意
工具调用会计费到你的 ScrapeUnblocker 账号,search_and_read 按一次搜索加每页一次请求计费。browse_page 并非只读:其步骤会作用于网站且不可重试,步骤失败不会重跑。把密钥放在 URL 中可能泄露到客户端日志或历史记录,建议使用请求头或 OAuth,泄露后请在控制台轮换密钥。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Scrapeunblocker Mcp Remote,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/com.scrapeunblocker%2Fscrapeunblocker-mcp-remote/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "scrapeunblocker-remote": {
      "type": "http",
      "url": "https://mcp.scrapeunblocker.com/mcp"
    }
  }
}

README

ScrapeUnblocker remote MCP server

A hosted (HTTP) Model Context Protocol server for ScrapeUnblocker, deployed as a Vercel serverless function. It lets claude.ai (web and mobile), Claude Desktop, Claude Code, and any other MCP client fetch any web page's HTML - or AI-parsed JSON, or Google results - through ScrapeUnblocker's anti-bot API, billed to your own account.

Prefer a local install with no hosting? Use the stdio package instead: scrapeunblocker-mcp.

Also listed on Smithery.

Endpoint

https://mcp.scrapeunblocker.com/mcp

You need a ScrapeUnblocker account - create a free one. There are two ways to authenticate, and you only need one of them.

A. Sign in with OAuth (recommended) - nothing to copy or paste. The server is an OAuth 2.1 Resource Server backed by Auth0, so the client runs a standard PKCE flow, and the server resolves your ScrapeUnblocker key server-side from the account you signed in with (the token is never passed through to the backend, per RFC 8707).

If your client asks for an OAuth client ID, use the public one - it is a PKCE client, so it carries no secret and is safe to share:

5BM5Wk2dE4ABkDITmuKfemPLnn3QQ8jd

Leave the client secret field empty.

B. Bring your own API key - handy for scripts and clients without an OAuth flow. Supply the key any of three ways:

  1. ?key=YOUR_KEY (or ?token=YOUR_KEY) in the URL.
  2. Authorization: Bearer YOUR_KEY header (a non-JWT value).
  3. x-scrapeunblocker-key: YOUR_KEY header.

Prefer a header (or OAuth) whenever your client lets you set one. The ?key= form exists for clients that only accept a URL (ChatGPT, some connector UIs); a key in a URL can end up in client logs or history, so treat that URL like the key itself and rotate the key in the dashboard if it leaks.

Listing the tools (initialize, tools/list) needs no credentials at all, so MCP directories and inspectors can introspect the server; actually running a tool does.

OAuth configuration (maintainers)

Env varPurpose
AUTH0_ISSUERAuth0 issuer URL, e.g. https://TENANT.auth0.com/ (trailing slash). Enables OAuth together with MCP_AUDIENCE.
MCP_AUDIENCECanonical MCP URI = the Auth0 API Identifier, https://mcp.scrapeunblocker.com/mcp. The token aud must match this.
MCP_EMAIL_CLAIMOptional namespaced claim carrying the user's email (set by an Auth0 Post-Login Action), e.g. https://scrapeunblocker.com/email. Falls back to the standard email claim.
MCP_RESOURCE_METADATA_URLOptional override for the RFC 9728 metadata URL advertised in WWW-Authenticate.
UTILS_API_BASE_URLutils-api base for the email_to_key lookup, e.g. https://utils-api.scrapeunblocker.com.
AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY / AWS_REGIONIAM creds (SigV4, execute-api) for calling utils-api.

Discovery endpoints served (via vercel.json rewrites): /.well-known/oauth-protected-resource and /.well-known/oauth-protected-resource/mcp.

Add it to claude.ai

  1. Customize → Connectors → + → Add custom connector.
  2. URL: https://mcp.scrapeunblocker.com/mcp
  3. Under Advanced settings, set OAuth Client ID to 5BM5Wk2dE4ABkDITmuKfemPLnn3QQ8jd and leave OAuth Client Secret empty.
  4. Add, then sign in and Authorize. The tools appear across claude.ai web, mobile, and Claude Desktop.

Or skip OAuth entirely and paste a personalised URL instead: https://mcp.scrapeunblocker.com/mcp?key=YOUR_API_KEY

Add it to Claude Code

bash
claude mcp add --transport http scrapeunblocker "https://mcp.scrapeunblocker.com/mcp?key=YOUR_API_KEY"

Add it to ChatGPT

Use ChatGPT on the web (chatgpt.com) - not the desktop app - on a paid plan (Plus/Pro/Business/Enterprise) with developer mode. All the tools are read-only, so Plus is enough.

  1. Settings → Plugins, turn on Developer mode.
  2. In Plugins, click + to open New Plugin.
  3. Keep Connection on Server URL, set Authentication to No Auth, tick the risk box, and paste the URL with your key: https://mcp.scrapeunblocker.com/mcp?key=YOUR_API_KEY
  4. Create. The tools are then available in any chat.

Full walkthrough with screenshots: docs.scrapeunblocker.com/sdks/chatgpt.

Tools

ToolWhat it does
fetch_htmlFetch the fully rendered HTML of a URL.
browse_pageRun steps on a page in a real browser (search, click, type, paginate), then return the resulting HTML. Not read-only: it acts on the website.
fetch_parsedFetch a page and return AI-parsed structured JSON.
google_searchRun a Google search and return the results page as JSON: organic results with real URLs, favicons, sitelinks and ratings, ads, AI Overview, People also ask, related searches with links, knowledge panel, news, videos, local and shopping results.
fetch_markdownFetch a page and return it as clean Markdown: the main content with absolute links, without scripts, styles, navigation or footer. Usually 2-25% the size of the HTML, so it is the cheap way for a model to read a page.
search_and_readSearch Google and read the top results in one call: Google's AI Overview (when there is one), the first 1-5 result pages as Markdown, and the other results as title, URL and snippet. Billed as one search plus one request per page read.
list_elementsReturn a page's interactive elements (buttons, inputs, selects, links, forms) with ready-to-use selectors, as JSON, to build steps.
list_pluginsList the ready-made site plugins (100+: Amazon, Walmart, Zillow, Booking.com, Indeed, Google Trends, YouTube, App Store, ...) with their parameters. Free - it calls nothing.
run_pluginRun one site plugin and return its structured JSON.
amazon_search, amazon_product, amazon_reviews, walmart_search, ebay_search, google_shopping, google_local, maps_place_details, google_images, youtube_search, youtube_transcript, zillow_search, indeed_jobs, trustpilot_reviews, booking_hotelsThe most-used site plugins as tools of their own, each with its parameters in the tool schema - one call, no list_plugins lookup. Same JSON as run_plugin.

Interacting with a page (steps)

browse_page takes a steps array - an ordered list of browser actions run in a real browser after the page loads, before the HTML is captured. Supported actions: wait_for, wait_for_text, wait, click, type (human-like keystrokes), select, press_key, scroll. A typical flow is: call list_elements to discover selectors, then call browse_page with steps to drive the page. It is the one tool not marked read-only, because steps act on the website.

Steps are non-idempotent - the request runs once and is not retried. If a step fails (bad selector, element never appeared), the tool returns an HTTP 422 result naming the offending step (step_index, action, reason, selector) plus the page HTML at the point of failure, so you can correct the step.

Deploy (maintainers)

This is a standard Vercel project - no build step, the function lives in api/mcp.ts. npm run typecheck and npm test (the tools against a local stand-in for the API) check it before a push.

bash
vercel            # previewvercel --prod     # production

Then point the mcp.scrapeunblocker.com domain at the Vercel project. Scraping calls can be slow and some plugins take longer than a minute, so the function's maxDuration is set to 300s in vercel.json.

License

MIT

来源:README.md,提交 ca3ee59

工具

24

fetch_html

Fetch page HTML

Fetch the fully rendered HTML of any web page through the ScrapeUnblocker API (https://docs.scrapeunblocker.com), bypassing anti-bot protection (Cloudflare, DataDome, PerimeterX, Akamai, Shape). Use when a normal fetch is blocked (403/429, captcha) or the page needs a real browser. Returns raw HTML. To read or summarise a page, fetch_markdown is much smaller. To click, type or scroll before capture, use browse_page.

输入参数url必填wait_valuewait_methodproxy_countrysleep_seconds

browse_page

Interact with a page, then capture it

Load a web page in a real browser through the ScrapeUnblocker API (https://docs.scrapeunblocker.com), run ordered browser actions on it (click, type into a search box, choose an option, press a key, scroll, wait), then return the resulting HTML. Discover selectors with list_elements first. Steps act on the website and are NOT idempotent - they run once per call and are not retried; never use them to buy, post, delete or change anything unless the user asked for exactly that. A failed step returns which step failed plus the page HTML at that point. Billed as one request.

输入参数url必填steps必填wait_valuewait_methodproxy_countrysleep_seconds

fetch_parsed

Fetch AI-parsed page data

Fetch a web page through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and return AI-parsed structured JSON instead of raw HTML (product details, article content, listings). If the page holds no structured data, the result says so and returns the rendered HTML instead (billed like fetch_html).

输入参数url必填proxy_country

list_elements

List interactive page elements

Fetch a page through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and return its interactive elements (buttons, inputs, selects, links, forms), each with a ready-to-use selector, as JSON {url, count, elements:[...]} instead of raw HTML. Use it to discover what to target, then drive the page with the `steps` param of browse_page.

输入参数url必填wait_valuewait_methodproxy_countrysleep_seconds

fetch_markdown

Fetch page as Markdown

Fetch a web page in a real browser through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and return it as clean Markdown: the main content with absolute links, without scripts, styles, navigation or footer. Use it to read, quote or summarise a page; it is usually 2-25% the size of the HTML. Works on JavaScript-rendered pages and on pages that refuse ordinary fetches (403/429, captcha). Use fetch_html instead when you need the markup, selectors or browser steps. Billed as one request.

输入参数url必填wait_valuewait_methodproxy_countrysleep_secondsmain_content_only

search_and_read

Search Google and read the top results

Search Google through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and read the top results in one call: returns Google's AI Overview when there is one, each of the first `results` pages (default 3, max 5) as Markdown, and the other organic results as title, URL and snippet. Use it to answer a question from the live web. Billed as one request for the search plus one per page read.

输入参数keyword必填resultsproxy_country

list_plugins

List site plugins

List ScrapeUnblocker's ready-made site plugins: scrapers for specific sites that return clean structured JSON (Amazon, Walmart, Target, eBay, Zillow, Redfin, Booking.com, Airbnb, Indeed, Glassdoor, Google Trends / Shopping / Maps, YouTube, Spotify, App Store, Google Play, Trustpilot, Yelp, Ahrefs, Semrush and 100+ more). Check here before scraping a known site with fetch_html - a plugin returns the data already parsed. Without arguments it lists every plugin with its parameters (* = required); `category` or `search` narrow the list; `name` returns one plugin's full parameter docs. Free - it calls nothing.

输入参数namesearchcategory

run_plugin

Run a site plugin

Run one ScrapeUnblocker site plugin and return its JSON - e.g. a Target or Walmart search, a Zillow listing search, Google Trends for some keywords, an app's App Store reviews. Find the plugin and its parameters with list_plugins first. `params` uses the parameter names list_plugins shows (snake_case); a list value is fine where a parameter takes several. Each run is billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数name必填params

amazon_product

Scrape an Amazon product page

Fetches a single Amazon product and returns it as JSON: `title`, `brand`, `price` + `currency`, `listPrice` and `savingsPercent`, `availability` (+ a boolean `inStock`), `rating`, `reviewCount`, `seller`, `features` (bullet points), `categories` (breadcrumb) and `images`. Identify the product with either `asin` (plus `marketplace`) or a full product `url`. Amazon prices each page in the currency of the delivery location it infers from the visitor's IP address, so `proxy_country` defaults to the marketplace's home country (amazon.com -> US) and the call is routed through proxies in that country. The country of the proxy that served the request is reported as `exitCountry`. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数urlasinmarketplaceproxy_country

amazon_reviews

Scrape the reviews on an Amazon product page

Returns the review data an Amazon product page shows to a signed-out visitor, as JSON: the overall `rating`, total `reviewCount` (global ratings), the 5..1-star `histogram` (percent per star), the AI `customersSay` summary (overall text plus per-aspect `sentiment`, `mentions`, `positive`, `negative`, `summary` and the quoted review `excerpts` Amazon shows for the aspect) and the top `reviews` (each with `id`, `url`, `author`, `rating`, `title`, `body`, `date`, `country`, `fromOtherCountry`, `verified`, `helpfulVotes`, `variant` and `images`). Identify the product with `asin` (plus `marketplace`) or a product `url`. Scope: Amazon only shows its full review list to signed-in customers, so this endpoint returns the public slice on the product page - typically 5 to 13 top reviews, local ones first and then reviews from other countries - not a complete review export. When Amazon hides the top reviews behind a sign-in prompt (common on amazon.com), `reviewsGated` is `true` and `reviews` is empty; the rating, histogram and customers-say data, including its review excerpts, are still returned. Every field is always present and is `null` when the page does not show it. `proxy_country` defaults to the marketplace's home country; the country of the proxy that served the request is reported as `exitCountry`. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数urlasinmarketplaceproxy_country

google_shopping

Scrape Google Shopping product listings

Runs the Google Shopping vertical (`udm=28`) for `q` and returns the product cards as JSON: `title`, `price`, `currency`, `currencyCode`, `originalPrice`, `discount`, `merchant`, `rating`, `reviewCount` and Google's own ids for the product (`productId`, `catalogId`, `offerId` - stable across searches, for tracking one product). Set `proxy_country`/`gl` to target a market (prices/merchants are region-specific) and `min_price`/`max_price` to filter. One render returns the first page of products (v1). Note: Google Shopping exposes no per-product URL, so `url` is omitted and `image` is best-effort. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数q必填glmax_pricemin_pricemax_resultsproxy_country

google_local

Scrape Google Local business listings

Runs a Google Local (`tbm=lcl`) search for `keyword` and returns up to ~20 businesses as JSON: `name`, `rating`, `reviews`, `price`, `category`, `address`, `phone`, `website`, `hours`, and a top `review_snippet`. `phone` and `website` are null when Google does not render them for that result - service businesses (plumbers, contractors) almost always carry both. Local results are location-sensitive - set `proxy_country` (and optionally `gl`/`hl`) to target a market. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数glhlkeyword必填proxy_country

maps_place_details

Scrape Google Maps place details

Returns the full data for one Google Maps place as JSON: `name`, `address` (+ `addressLines`), `phone`, `website`, `rating`, `categories`, `latitude`/`longitude`, `plusCode`, `hours` + `openNow`, `description`, `photo`, `cid`, `featureId`, `googleMapsUrl` and `relatedPlaces`. Identify the place with `place_id` (ChIJ...), a Maps `url`, or a raw `feature_id` (0xHEX:0xHEX). Location-neutral - the feature id resolves the place directly; `proxy_country` defaults to a US proxy to clear Google's consent wall. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数glhlrawurlplace_idfeature_idproxy_country

google_images

Scrape Google Images results

Runs the Google Images vertical (`udm=2`) for `q` and returns the image results as JSON. Every result carries `imageUrl` (the full-resolution origin image, not a Google thumbnail; for an image found inside a document such as a PDF, which has no URL of its own, it is Google's thumbnail and `sourcePageUrl` is the document), `sourceDomain` and `googleImagesUrl` (the Google Images viewer link, i.e. the `/imgres?...` URL a browser copies from the result tile), plus `sourcePageUrl`, `title`, `sourceName`, `thumbnailUrl`, `width`, `height` and `fileSize` where available. Set `proxy_country` to target a market: the Google market (`gl`) follows it automatically, and `gl` is only an optional override. `pages` fetches up to 5 result pages of ~100 each; every page fetched is billed as one request. `time_range` (past hour/day/week/month/year) or `date_from`/`date_to` limit the results to images Google found in that period, so a repeated scan returns only what is new. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数q必填glpagesdate_todate_fromtime_rangemax_resultsproxy_country

youtube_transcript

Get a YouTube video transcript

Returns a YouTube video's captions as JSON: timestamped `segments` (`start`, `dur`, `text`) and a joined `text`, plus `availableLanguages`, the picked `language`, `isAutoGenerated`, and the video's `title`, `author` and `lengthSeconds`. Pass a video id or any YouTube video URL; choose a caption language with `lang`. Ideal for LLM/RAG pipelines, subtitles and content analysis. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数langvideo必填formatproxy_country

indeed_jobs

Scrape Indeed job listings

Searches Indeed for `query` in `location` and returns the job listings as JSON: `title`, `company`, `location`, `salary` (with parsed `min`/`max`), `jobTypes`, `companyRating`, a `snippet`, `datePosted` (YYYY-MM-DD), `sponsored` (Indeed's paid placement) and a clean job `url`. Filter with `country`, `job_type`, `days` (posting age), `remote`, sort with `sort` (`date` returns the collected jobs newest first, sponsored ones included), and collect up to `max_results` across pages. Indeed sits behind Cloudflare + PerimeterX - handled for you. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数dayssortquery必填startradiusremotecountryjob_typelocationmax_resultsproxy_country

trustpilot_reviews

Scrape Trustpilot company reviews

Returns a company's Trustpilot profile and reviews as JSON. `company` is the reviewed domain (e.g. `www.nike.com`). The response has a `company` summary (`trustScore`, `totalReviews`, `ratingDistribution` 1-5, `categories`, `contact`) and a `reviews` array - each with `rating`, `title`, `text`, `verified`, `author` (name, country, review count), `reply` (the company's response) and dates. Page with `page`/`pages` (20 reviews per page), and filter with `stars`, `sort` (recency/relevancy), `language`, `date`, `search`, `verified` or `replies`. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数datepagesortpagesstarssearchcompany必填replieslanguageverifiedproxy_country

booking_hotels

Scrape Booking.com hotels

Searches Booking.com for `location` and returns the properties as JSON: `name`, `price` (with `checkin`/`checkout`), `reviewScore`, `address`, coordinates, `image` and a hotel `url`. Set `adults`, `children`, `rooms` and `currency`, and collect up to `max_results` across pages. Prices only appear when check-in/check-out dates are given. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

输入参数roomsadultscheckincheckoutchildrencurrencylocation必填max_resultsproxy_country

版本历史

14
  1. v0.13.6最新Nov 5, 2026
  2. v0.13.5Nov 4, 2026
  3. v0.13.3Nov 4, 2026
  4. v0.13.2Nov 3, 2026
  5. v0.13.1Nov 3, 2026
  6. v0.12.1Oct 30, 2026
  7. v0.12.0Oct 30, 2026
  8. v0.11.0Oct 29, 2026
  9. v0.9.1Oct 25, 2026
  10. v0.9.0Oct 23, 2026
  11. v0.7.0Oct 20, 2026
  12. v0.5.0Oct 16, 2026
  13. v0.4.0Oct 13, 2026
  14. v0.2.1Sep 16, 2026

评分

已满足适用检查项的 100%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分

其他 Scrapeunblocker 集成