Scrapeunblocker Mcp Remote

com.scrapeunblocker由 scrapeunblocker.com 發布官方發布者v0.13.6更新於 Nov 5, 2026

Fetch any page's HTML or AI-parsed JSON, Google results, or 100+ site plugins via ScrapeUnblocker

已驗證Streamable HTTP可網頁執行位置與生活網頁搜尋與抓取商業與電商

概覽

AI 產生的概覽

託管的 ScrapeUnblocker MCP 伺服器,讓助理抓取被反爬機制阻擋的網頁、執行 Google 搜尋,並透過 100 多個網站外掛取得結構化資料。

可以做什麼
  • 以渲染後的 HTML、乾淨的 Markdown 或 AI 解析的 JSON 抓取網頁,繞過反爬保護
  • 執行 Google 搜尋,回傳 AI 概覽、相關問題與相關搜尋,並可一次呼叫搜尋並閱讀前幾筆結果
  • 先找出頁面元素的選擇器,再用有序步驟(點擊、輸入、選擇、捲動、等待)操作真實瀏覽器
  • 列出並執行現成的網站外掛,取得結構化 JSON
  • 使用 Amazon、Walmart、eBay、Google 購物、在地、圖片、地圖、YouTube、Zillow、Indeed、Trustpilot 與 Booking.com 的專用工具
適用情境
適合一般抓取被驗證碼或 403/429 阻擋時、需要 Google 搜尋結果或商品、房源、職缺、評價、旅遊等結構化資料時,或希望以 Markdown 低成本讀取網頁時。
執行需求
遠端 HTTP 端點,需要 ScrapeUnblocker 帳號。可用 OAuth 登入,或以 API 金鑰驗證:x-scrapeunblocker-key 標頭、Authorization Bearer 標頭,或網址中的金鑰查詢參數。列出工具不需憑證,實際執行工具則需要。
安裝前請注意
工具呼叫會計費到你的 ScrapeUnblocker 帳號,search_and_read 以一次搜尋加每頁一次請求計費。browse_page 並非唯讀:其步驟會作用於網站且不會重試,步驟失敗不會重跑。把金鑰放在網址中可能外洩到用戶端日誌或歷史紀錄,建議改用標頭或 OAuth,外洩後請在後台輪換金鑰。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Scrapeunblocker Mcp Remote,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Web executable,透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

交給代理程式安裝

把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式,或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南,先向你展示發布者、端點和登入方式,經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。

閱讀 https://sourceweft.com/mcp/com.scrapeunblocker%2Fscrapeunblocker-mcp-remote/install.md,並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前,先告訴我它的發布者、端點和登入方式,等我確認。不要把 API 金鑰寫進命令或我會提交的檔案;問我金鑰應從哪裡取得。

檢視代理程式所依據的安裝指南

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。

{
  "mcpServers": {
    "scrapeunblocker-remote": {
      "type": "http",
      "url": "https://mcp.scrapeunblocker.com/mcp"
    }
  }
}

README

ScrapeUnblocker remote MCP server

A hosted (HTTP) Model Context Protocol server for ScrapeUnblocker, deployed as a Vercel serverless function. It lets claude.ai (web and mobile), Claude Desktop, Claude Code, and any other MCP client fetch any web page's HTML - or AI-parsed JSON, or Google results - through ScrapeUnblocker's anti-bot API, billed to your own account.

Prefer a local install with no hosting? Use the stdio package instead: scrapeunblocker-mcp.

Also listed on Smithery.

Endpoint

https://mcp.scrapeunblocker.com/mcp

You need a ScrapeUnblocker account - create a free one. There are two ways to authenticate, and you only need one of them.

A. Sign in with OAuth (recommended) - nothing to copy or paste. The server is an OAuth 2.1 Resource Server backed by Auth0, so the client runs a standard PKCE flow, and the server resolves your ScrapeUnblocker key server-side from the account you signed in with (the token is never passed through to the backend, per RFC 8707).

If your client asks for an OAuth client ID, use the public one - it is a PKCE client, so it carries no secret and is safe to share:

5BM5Wk2dE4ABkDITmuKfemPLnn3QQ8jd

Leave the client secret field empty.

B. Bring your own API key - handy for scripts and clients without an OAuth flow. Supply the key any of three ways:

  1. ?key=YOUR_KEY (or ?token=YOUR_KEY) in the URL.
  2. Authorization: Bearer YOUR_KEY header (a non-JWT value).
  3. x-scrapeunblocker-key: YOUR_KEY header.

Prefer a header (or OAuth) whenever your client lets you set one. The ?key= form exists for clients that only accept a URL (ChatGPT, some connector UIs); a key in a URL can end up in client logs or history, so treat that URL like the key itself and rotate the key in the dashboard if it leaks.

Listing the tools (initialize, tools/list) needs no credentials at all, so MCP directories and inspectors can introspect the server; actually running a tool does.

OAuth configuration (maintainers)

Env varPurpose
AUTH0_ISSUERAuth0 issuer URL, e.g. https://TENANT.auth0.com/ (trailing slash). Enables OAuth together with MCP_AUDIENCE.
MCP_AUDIENCECanonical MCP URI = the Auth0 API Identifier, https://mcp.scrapeunblocker.com/mcp. The token aud must match this.
MCP_EMAIL_CLAIMOptional namespaced claim carrying the user's email (set by an Auth0 Post-Login Action), e.g. https://scrapeunblocker.com/email. Falls back to the standard email claim.
MCP_RESOURCE_METADATA_URLOptional override for the RFC 9728 metadata URL advertised in WWW-Authenticate.
UTILS_API_BASE_URLutils-api base for the email_to_key lookup, e.g. https://utils-api.scrapeunblocker.com.
AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY / AWS_REGIONIAM creds (SigV4, execute-api) for calling utils-api.

Discovery endpoints served (via vercel.json rewrites): /.well-known/oauth-protected-resource and /.well-known/oauth-protected-resource/mcp.

Add it to claude.ai

  1. Customize → Connectors → + → Add custom connector.
  2. URL: https://mcp.scrapeunblocker.com/mcp
  3. Under Advanced settings, set OAuth Client ID to 5BM5Wk2dE4ABkDITmuKfemPLnn3QQ8jd and leave OAuth Client Secret empty.
  4. Add, then sign in and Authorize. The tools appear across claude.ai web, mobile, and Claude Desktop.

Or skip OAuth entirely and paste a personalised URL instead: https://mcp.scrapeunblocker.com/mcp?key=YOUR_API_KEY

Add it to Claude Code

bash
claude mcp add --transport http scrapeunblocker "https://mcp.scrapeunblocker.com/mcp?key=YOUR_API_KEY"

Add it to ChatGPT

Use ChatGPT on the web (chatgpt.com) - not the desktop app - on a paid plan (Plus/Pro/Business/Enterprise) with developer mode. All the tools are read-only, so Plus is enough.

  1. Settings → Plugins, turn on Developer mode.
  2. In Plugins, click + to open New Plugin.
  3. Keep Connection on Server URL, set Authentication to No Auth, tick the risk box, and paste the URL with your key: https://mcp.scrapeunblocker.com/mcp?key=YOUR_API_KEY
  4. Create. The tools are then available in any chat.

Full walkthrough with screenshots: docs.scrapeunblocker.com/sdks/chatgpt.

Tools

ToolWhat it does
fetch_htmlFetch the fully rendered HTML of a URL.
browse_pageRun steps on a page in a real browser (search, click, type, paginate), then return the resulting HTML. Not read-only: it acts on the website.
fetch_parsedFetch a page and return AI-parsed structured JSON.
google_searchRun a Google search and return the results page as JSON: organic results with real URLs, favicons, sitelinks and ratings, ads, AI Overview, People also ask, related searches with links, knowledge panel, news, videos, local and shopping results.
fetch_markdownFetch a page and return it as clean Markdown: the main content with absolute links, without scripts, styles, navigation or footer. Usually 2-25% the size of the HTML, so it is the cheap way for a model to read a page.
search_and_readSearch Google and read the top results in one call: Google's AI Overview (when there is one), the first 1-5 result pages as Markdown, and the other results as title, URL and snippet. Billed as one search plus one request per page read.
list_elementsReturn a page's interactive elements (buttons, inputs, selects, links, forms) with ready-to-use selectors, as JSON, to build steps.
list_pluginsList the ready-made site plugins (100+: Amazon, Walmart, Zillow, Booking.com, Indeed, Google Trends, YouTube, App Store, ...) with their parameters. Free - it calls nothing.
run_pluginRun one site plugin and return its structured JSON.
amazon_search, amazon_product, amazon_reviews, walmart_search, ebay_search, google_shopping, google_local, maps_place_details, google_images, youtube_search, youtube_transcript, zillow_search, indeed_jobs, trustpilot_reviews, booking_hotelsThe most-used site plugins as tools of their own, each with its parameters in the tool schema - one call, no list_plugins lookup. Same JSON as run_plugin.

Interacting with a page (steps)

browse_page takes a steps array - an ordered list of browser actions run in a real browser after the page loads, before the HTML is captured. Supported actions: wait_for, wait_for_text, wait, click, type (human-like keystrokes), select, press_key, scroll. A typical flow is: call list_elements to discover selectors, then call browse_page with steps to drive the page. It is the one tool not marked read-only, because steps act on the website.

Steps are non-idempotent - the request runs once and is not retried. If a step fails (bad selector, element never appeared), the tool returns an HTTP 422 result naming the offending step (step_index, action, reason, selector) plus the page HTML at the point of failure, so you can correct the step.

Deploy (maintainers)

This is a standard Vercel project - no build step, the function lives in api/mcp.ts. npm run typecheck and npm test (the tools against a local stand-in for the API) check it before a push.

bash
vercel            # previewvercel --prod     # production

Then point the mcp.scrapeunblocker.com domain at the Vercel project. Scraping calls can be slow and some plugins take longer than a minute, so the function's maxDuration is set to 300s in vercel.json.

License

MIT

來源:README.md,提交 ca3ee59

工具

24

fetch_html

Fetch page HTML

Fetch the fully rendered HTML of any web page through the ScrapeUnblocker API (https://docs.scrapeunblocker.com), bypassing anti-bot protection (Cloudflare, DataDome, PerimeterX, Akamai, Shape). Use when a normal fetch is blocked (403/429, captcha) or the page needs a real browser. Returns raw HTML. To read or summarise a page, fetch_markdown is much smaller. To click, type or scroll before capture, use browse_page.

輸入參數url必填wait_valuewait_methodproxy_countrysleep_seconds

browse_page

Interact with a page, then capture it

Load a web page in a real browser through the ScrapeUnblocker API (https://docs.scrapeunblocker.com), run ordered browser actions on it (click, type into a search box, choose an option, press a key, scroll, wait), then return the resulting HTML. Discover selectors with list_elements first. Steps act on the website and are NOT idempotent - they run once per call and are not retried; never use them to buy, post, delete or change anything unless the user asked for exactly that. A failed step returns which step failed plus the page HTML at that point. Billed as one request.

輸入參數url必填steps必填wait_valuewait_methodproxy_countrysleep_seconds

fetch_parsed

Fetch AI-parsed page data

Fetch a web page through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and return AI-parsed structured JSON instead of raw HTML (product details, article content, listings). If the page holds no structured data, the result says so and returns the rendered HTML instead (billed like fetch_html).

輸入參數url必填proxy_country

list_elements

List interactive page elements

Fetch a page through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and return its interactive elements (buttons, inputs, selects, links, forms), each with a ready-to-use selector, as JSON {url, count, elements:[...]} instead of raw HTML. Use it to discover what to target, then drive the page with the `steps` param of browse_page.

輸入參數url必填wait_valuewait_methodproxy_countrysleep_seconds

fetch_markdown

Fetch page as Markdown

Fetch a web page in a real browser through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and return it as clean Markdown: the main content with absolute links, without scripts, styles, navigation or footer. Use it to read, quote or summarise a page; it is usually 2-25% the size of the HTML. Works on JavaScript-rendered pages and on pages that refuse ordinary fetches (403/429, captcha). Use fetch_html instead when you need the markup, selectors or browser steps. Billed as one request.

輸入參數url必填wait_valuewait_methodproxy_countrysleep_secondsmain_content_only

search_and_read

Search Google and read the top results

Search Google through the ScrapeUnblocker API (https://docs.scrapeunblocker.com) and read the top results in one call: returns Google's AI Overview when there is one, each of the first `results` pages (default 3, max 5) as Markdown, and the other organic results as title, URL and snippet. Use it to answer a question from the live web. Billed as one request for the search plus one per page read.

輸入參數keyword必填resultsproxy_country

list_plugins

List site plugins

List ScrapeUnblocker's ready-made site plugins: scrapers for specific sites that return clean structured JSON (Amazon, Walmart, Target, eBay, Zillow, Redfin, Booking.com, Airbnb, Indeed, Glassdoor, Google Trends / Shopping / Maps, YouTube, Spotify, App Store, Google Play, Trustpilot, Yelp, Ahrefs, Semrush and 100+ more). Check here before scraping a known site with fetch_html - a plugin returns the data already parsed. Without arguments it lists every plugin with its parameters (* = required); `category` or `search` narrow the list; `name` returns one plugin's full parameter docs. Free - it calls nothing.

輸入參數namesearchcategory

run_plugin

Run a site plugin

Run one ScrapeUnblocker site plugin and return its JSON - e.g. a Target or Walmart search, a Zillow listing search, Google Trends for some keywords, an app's App Store reviews. Find the plugin and its parameters with list_plugins first. `params` uses the parameter names list_plugins shows (snake_case); a list value is fine where a parameter takes several. Each run is billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數name必填params

amazon_product

Scrape an Amazon product page

Fetches a single Amazon product and returns it as JSON: `title`, `brand`, `price` + `currency`, `listPrice` and `savingsPercent`, `availability` (+ a boolean `inStock`), `rating`, `reviewCount`, `seller`, `features` (bullet points), `categories` (breadcrumb) and `images`. Identify the product with either `asin` (plus `marketplace`) or a full product `url`. Amazon prices each page in the currency of the delivery location it infers from the visitor's IP address, so `proxy_country` defaults to the marketplace's home country (amazon.com -> US) and the call is routed through proxies in that country. The country of the proxy that served the request is reported as `exitCountry`. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數urlasinmarketplaceproxy_country

amazon_reviews

Scrape the reviews on an Amazon product page

Returns the review data an Amazon product page shows to a signed-out visitor, as JSON: the overall `rating`, total `reviewCount` (global ratings), the 5..1-star `histogram` (percent per star), the AI `customersSay` summary (overall text plus per-aspect `sentiment`, `mentions`, `positive`, `negative`, `summary` and the quoted review `excerpts` Amazon shows for the aspect) and the top `reviews` (each with `id`, `url`, `author`, `rating`, `title`, `body`, `date`, `country`, `fromOtherCountry`, `verified`, `helpfulVotes`, `variant` and `images`). Identify the product with `asin` (plus `marketplace`) or a product `url`. Scope: Amazon only shows its full review list to signed-in customers, so this endpoint returns the public slice on the product page - typically 5 to 13 top reviews, local ones first and then reviews from other countries - not a complete review export. When Amazon hides the top reviews behind a sign-in prompt (common on amazon.com), `reviewsGated` is `true` and `reviews` is empty; the rating, histogram and customers-say data, including its review excerpts, are still returned. Every field is always present and is `null` when the page does not show it. `proxy_country` defaults to the marketplace's home country; the country of the proxy that served the request is reported as `exitCountry`. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數urlasinmarketplaceproxy_country

google_shopping

Scrape Google Shopping product listings

Runs the Google Shopping vertical (`udm=28`) for `q` and returns the product cards as JSON: `title`, `price`, `currency`, `currencyCode`, `originalPrice`, `discount`, `merchant`, `rating`, `reviewCount` and Google's own ids for the product (`productId`, `catalogId`, `offerId` - stable across searches, for tracking one product). Set `proxy_country`/`gl` to target a market (prices/merchants are region-specific) and `min_price`/`max_price` to filter. One render returns the first page of products (v1). Note: Google Shopping exposes no per-product URL, so `url` is omitted and `image` is best-effort. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數q必填glmax_pricemin_pricemax_resultsproxy_country

google_local

Scrape Google Local business listings

Runs a Google Local (`tbm=lcl`) search for `keyword` and returns up to ~20 businesses as JSON: `name`, `rating`, `reviews`, `price`, `category`, `address`, `phone`, `website`, `hours`, and a top `review_snippet`. `phone` and `website` are null when Google does not render them for that result - service businesses (plumbers, contractors) almost always carry both. Local results are location-sensitive - set `proxy_country` (and optionally `gl`/`hl`) to target a market. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數glhlkeyword必填proxy_country

maps_place_details

Scrape Google Maps place details

Returns the full data for one Google Maps place as JSON: `name`, `address` (+ `addressLines`), `phone`, `website`, `rating`, `categories`, `latitude`/`longitude`, `plusCode`, `hours` + `openNow`, `description`, `photo`, `cid`, `featureId`, `googleMapsUrl` and `relatedPlaces`. Identify the place with `place_id` (ChIJ...), a Maps `url`, or a raw `feature_id` (0xHEX:0xHEX). Location-neutral - the feature id resolves the place directly; `proxy_country` defaults to a US proxy to clear Google's consent wall. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數glhlrawurlplace_idfeature_idproxy_country

google_images

Scrape Google Images results

Runs the Google Images vertical (`udm=2`) for `q` and returns the image results as JSON. Every result carries `imageUrl` (the full-resolution origin image, not a Google thumbnail; for an image found inside a document such as a PDF, which has no URL of its own, it is Google's thumbnail and `sourcePageUrl` is the document), `sourceDomain` and `googleImagesUrl` (the Google Images viewer link, i.e. the `/imgres?...` URL a browser copies from the result tile), plus `sourcePageUrl`, `title`, `sourceName`, `thumbnailUrl`, `width`, `height` and `fileSize` where available. Set `proxy_country` to target a market: the Google market (`gl`) follows it automatically, and `gl` is only an optional override. `pages` fetches up to 5 result pages of ~100 each; every page fetched is billed as one request. `time_range` (past hour/day/week/month/year) or `date_from`/`date_to` limit the results to images Google found in that period, so a repeated scan returns only what is new. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數q必填glpagesdate_todate_fromtime_rangemax_resultsproxy_country

youtube_transcript

Get a YouTube video transcript

Returns a YouTube video's captions as JSON: timestamped `segments` (`start`, `dur`, `text`) and a joined `text`, plus `availableLanguages`, the picked `language`, `isAutoGenerated`, and the video's `title`, `author` and `lengthSeconds`. Pass a video id or any YouTube video URL; choose a caption language with `lang`. Ideal for LLM/RAG pipelines, subtitles and content analysis. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數langvideo必填formatproxy_country

indeed_jobs

Scrape Indeed job listings

Searches Indeed for `query` in `location` and returns the job listings as JSON: `title`, `company`, `location`, `salary` (with parsed `min`/`max`), `jobTypes`, `companyRating`, a `snippet`, `datePosted` (YYYY-MM-DD), `sponsored` (Indeed's paid placement) and a clean job `url`. Filter with `country`, `job_type`, `days` (posting age), `remote`, sort with `sort` (`date` returns the collected jobs newest first, sponsored ones included), and collect up to `max_results` across pages. Indeed sits behind Cloudflare + PerimeterX - handled for you. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數dayssortquery必填startradiusremotecountryjob_typelocationmax_resultsproxy_country

trustpilot_reviews

Scrape Trustpilot company reviews

Returns a company's Trustpilot profile and reviews as JSON. `company` is the reviewed domain (e.g. `www.nike.com`). The response has a `company` summary (`trustScore`, `totalReviews`, `ratingDistribution` 1-5, `categories`, `contact`) and a `reviews` array - each with `rating`, `title`, `text`, `verified`, `author` (name, country, review count), `reply` (the company's response) and dates. Page with `page`/`pages` (20 reviews per page), and filter with `stars`, `sort` (recency/relevancy), `language`, `date`, `search`, `verified` or `replies`. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數datepagesortpagesstarssearchcompany必填replieslanguageverifiedproxy_country

booking_hotels

Scrape Booking.com hotels

Searches Booking.com for `location` and returns the properties as JSON: `name`, `price` (with `checkin`/`checkout`), `reviewScore`, `address`, coordinates, `image` and a hotel `url`. Set `adults`, `children`, `rooms` and `currency`, and collect up to `max_results` across pages. Prices only appear when check-in/check-out dates are given. Returns JSON. Billed like an API request; listing plugins bill one unit per result page they fetch, so keep max_results modest.

輸入參數roomsadultscheckincheckoutchildrencurrencylocation必填max_resultsproxy_country

版本歷史

14
  1. v0.13.6最新Nov 5, 2026
  2. v0.13.5Nov 4, 2026
  3. v0.13.3Nov 4, 2026
  4. v0.13.2Nov 3, 2026
  5. v0.13.1Nov 3, 2026
  6. v0.12.1Oct 30, 2026
  7. v0.12.0Oct 30, 2026
  8. v0.11.0Oct 29, 2026
  9. v0.9.1Oct 25, 2026
  10. v0.9.0Oct 23, 2026
  11. v0.7.0Oct 20, 2026
  12. v0.5.0Oct 16, 2026
  13. v0.4.0Oct 13, 2026
  14. v0.2.1Sep 16, 2026

評分

已滿足適用檢查項的 100%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通必需25 分
  • 已宣告認證方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分

其他 Scrapeunblocker 整合