Scrapfly

io.scrapfly.mcp由 mcp.scrapfly.io 發布v1.0.0更新於 Oct 26, 2026

Scrape any website, extract structured data, and collect web content at scale with AI agents

概覽

AI 產生的概覽

Scrapfly MCP 讓助理即時存取網頁:擷取頁面、抽取結構化資料、截圖,並操作雲端瀏覽器工作階段。

可以做什麼
  • 擷取與蒐集網頁,支援 JS 渲染、代理池與國家定位,並可一次性截圖與判斷是否被攔截
  • 從複雜網站抽取結構化 JSON,並查詢帳戶方案、額度用量與目前 API 金鑰資訊
  • 開啟並管理具狀態的雲端瀏覽器工作階段,包括反爬繞過、導覽、下載檔案與效能測試
  • 與已開啟的工作階段互動:快照、點擊、輸入、捲動、執行腳本與尋找元素
  • 管理用於登入的憑證保險庫(可選擇從 1Password 同步),並建立、測試或暫停帳戶指標告警規則
適用情境
當助理需要訓練資料之外的即時網頁內容時適用,例如價格、商品清單、新聞,或需要 JavaScript 渲染與反爬繞過的頁面。也適合以截圖做視覺檢查,以及登入等多步驟瀏覽器流程。
執行需求
需要 Scrapfly 帳戶與 API 金鑰,或在託管遠端端點使用 OAuth2 登入。託管服務無須安裝;本機執行需 npm 套件或自架二進位檔/Docker 映像,並以 SCRAPFLY_API_KEY 或每次請求的 Bearer 金鑰驗證。需要能連線至 Scrapfly 的網路。
安裝前請注意
擷取會消耗付費 API 額度,不同代理池價格不同,部分目標必須使用較貴的 unblocker_ultra 池。憑證保險庫工具會保存網站登入資訊,告警工具會寫入帳戶。自架的伺服器金鑰模式沒有逐一呼叫者驗證,應只綁定本機回環位址。擷取的頁面內容與請求會傳送至 Scrapfly 服務。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Scrapfly,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

Scrapfly MCP Server

[Scrapfly]

Give your AI real-time access to any website

🌐 Landing Page • 📖 Documentation • 🎮 Live Demo • 🔑 Get API Key


At a glance

Remote serverhttps://mcp.scrapfly.io/mcp (streamable HTTP, nothing to install)
Self-hostedGo binary (stdio or -http) or the Docker image of this repo, see Self-Hosted below
stdio-only clientsnpx mcp-remote https://mcp.scrapfly.io/mcp
AuthenticationOAuth2 sign-in on the remote server, or a Scrapfly API key (SCRAPFLY_API_KEY, Authorization: Bearer <key>)
Tools62: web scraping (5), account (2), Cloud Browser sessions (9), page interaction (17), WebMCP (2), credential vaults (15), alerts (12). Full list under Available Tools below.

Add it to any MCP client:

json
{  "mcpServers": {    "scrapfly": { "type": "http", "url": "https://mcp.scrapfly.io/mcp" }  }}

Tools that fetch pages need no setup beyond the key: web_get_page (quick fetch), web_scrape (full control: JS rendering, proxy pool, country, extraction) and screenshot.


What is Scrapfly MCP?

The Scrapfly MCP Server connects your AI assistants to live web data through the Model Context Protocol. Transform your AI from being limited by training data to having real-time access to any website.

✨ What Your AI Can Do

CapabilityDescription
🌐 Scrape Live DataPull current prices, listings, news, or any webpage content in real-time
🛡️ Bypass Anti-Bot SystemsAutomatically handle CAPTCHAs, proxies, JavaScript rendering, and rate limits
⚡ Extract Structured DataParse complex websites into clean JSON using AI-powered extraction
📸 Capture ScreenshotsTake visual snapshots of pages or specific elements for analysis

🏆 Why Scrapfly?

Built on battle-tested infrastructure used by thousands of developers:

📖 Learn more: Why Scrapfly MCP?


🚀 Quick Install

Click one of the buttons below to install the MCP server in your preferred IDE:

[Install in VS Code] [Install in VS Code Insiders] [Install in Visual Studio] [Install in Cursor]


📦 Manual Installation

Standard Configuration

Works with most MCP-compatible tools:

json
{  "servers": {    "scrapfly-cloud-mcp": {      "type": "http",      "url": "https://mcp.scrapfly.io/mcp"    }  }}

Cloud Configuration (NPX)

For tools that require a local process:

json
{  "mcpServers": {    "scrapfly": {      "command": "npx",      "args": [        "mcp-remote",        "https://mcp.scrapfly.io/mcp"      ]    }  }}

🔧 IDE-Specific Setup

VS Code

One-Click Install

[Install in VS Code]

Manual Install

Follow the VS Code MCP guide or use the CLI:

bash
code --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'

After installation, Scrapfly tools will be available in GitHub Copilot Chat.

📖 Full guide: VS Code Integration

VS Code Insiders

One-Click Install

[Install in VS Code Insiders]

Manual Install

bash
code-insiders --add-mcp '{"name":"scrapfly-cloud-mcp","type":"http","url":"https://mcp.scrapfly.io/mcp"}'

📖 Full guide: VS Code Integration

Visual Studio

One-Click Install

[Install in Visual Studio]

Manual Install

  1. Open Visual Studio
  2. Navigate to GitHub Copilot Chat window
  3. Click the tools icon (🛠️) in the chat toolbar
  4. Click + Add Server to open the configuration dialog
  5. Configure:
    • Server ID: scrapfly-cloud-mcp
    • Type: http/sse
    • URL: https://mcp.scrapfly.io/mcp
  6. Click Save

📖 Full guide: Visual Studio MCP documentation

Cursor

One-Click Install

[Install in Cursor]

Manual Install

  1. Go to Cursor Settings → MCP → Add new MCP Server
  2. Use the standard configuration above
  3. Click Edit to verify or add arguments

📖 Full guide: Cursor Integration

Claude Code

Use the Claude Code CLI:

bash
claude mcp add scrapfly-cloud-mcp --url https://mcp.scrapfly.io/mcp

📖 Full guide: Claude Code Integration

Claude Desktop

Add to your Claude Desktop configuration file:

macOS: ~/Library/Application Support/Claude/claude_desktop_config.json Windows: %APPDATA%\Claude\claude_desktop_config.json

json
{  "mcpServers": {    "scrapfly": {      "command": "npx",      "args": ["mcp-remote", "https://mcp.scrapfly.io/mcp"]    }  }}

📖 Full guide: Claude Desktop Integration

Cline

Add to your Cline MCP settings:

json
{  "scrapfly-cloud-mcp": {    "type": "http",    "url": "https://mcp.scrapfly.io/mcp"  }}

📖 Full guide: Cline Integration

Windsurf

Follow the Windsurf MCP documentation using the standard configuration.

📖 Full guide: Windsurf Integration

Zed

Add to your Zed settings:

json
{  "context_servers": {    "scrapfly-cloud-mcp": {      "type": "http",      "url": "https://mcp.scrapfly.io/mcp"    }  }}

📖 Full guide: Zed Integration

OpenAI Codex

Create or edit ~/.codex/config.toml:

toml
[mcp_servers.scrapfly-cloud-mcp]url = "https://mcp.scrapfly.io/mcp"

📖 More info: Codex MCP documentation

Gemini CLI

Follow the Gemini CLI MCP guide using the standard configuration.

OpenCode

Add to ~/.config/opencode/opencode.json:

json
{  "$schema": "https://opencode.ai/config.json",  "mcp": {    "scrapfly-cloud-mcp": {      "type": "http",      "url": "https://mcp.scrapfly.io/mcp",      "enabled": true    }  }}

📖 More info: OpenCode MCP documentation


🛠️ Available Tools

The Scrapfly MCP Server exposes 62 tools in seven groups. Most tasks need only the first group.

Web scraping (5)

Stateless, one call per page.

ToolDescriptionUse Case
scraping_instruction_enhancedCheat-sheet of the scraping optionsOptional, when the right options are unclear
web_get_pageQuick page fetch with smart defaultsSimple scraping tasks
web_scrapeFull control: headers, JS rendering, country, proxy pool, extractionComplex scraping, login flows
screenshotOne-shot PNG of a URLVisual analysis, monitoring
check_if_blockedDecide whether a scrape result is a block pageRetry or escalate the proxy pool

Account (2)

ToolDescription
info_accountSubscription plan, API credit usage, concurrency
info_api_keyThe API key this server is authenticated with

Cloud Browser sessions (9)

A stateful real browser, kept between calls.

ToolDescription
cloud_browser_openStart a session at a URL
browser_unblockSame, through the anti-bot bypass first
cloud_browser_navigateLoad a new URL in the open session
cloud_browser_sessionsList active sessions
cloud_browser_closeClose the session
cloud_browser_screenshotPNG of the session, optionally of a CSS selector
cloud_browser_evalRun JavaScript and return its value
cloud_browser_downloadsFiles downloaded during the session
cloud_browser_performancePageSpeed-style lab run with mobile throttling

Page interaction (17)

Act on the open Cloud Browser session. Elements are addressed by the uid that take_snapshot returns.

take_snapshot, take_screenshot, find_elements, get_page_url, evaluate_script, click, hover, drag, fill, type_text, press_key, select_option, dropdown_options, scroll, scroll_to_text, go_back, wait

WebMCP (2)

For pages that register their own tools with navigator.modelContext.

list_webmcp_tools, call_webmcp_tool

Credential vaults (15)

Store logins for Cloud Browser sessions, optionally mirrored from 1Password.

cloud_browser_vault_create, cloud_browser_vault_list, cloud_browser_vault_get, cloud_browser_vault_update, cloud_browser_vault_delete, cloud_browser_vault_rotate, cloud_browser_vault_item_create, cloud_browser_vault_item_list, cloud_browser_vault_item_update, cloud_browser_vault_item_delete, cloud_browser_vault_service_link, cloud_browser_vault_service_update, cloud_browser_vault_service_sync, cloud_browser_vault_service_test, cloud_browser_vault_service_unlink

Alerts (12)

Create, test and snooze alert rules on your account metrics. Writes take a confirm step.

alert_metric_families, alert_preview, alert_create, alert_update, alert_delete, alert_get, alert_list, alert_count_active, alert_series, alert_test, alert_snooze, alert_unsnooze

📖 Full reference: Tools & API Specification

Proxy pools

web_scrape and web_get_page take a proxy_pool, which sets both the proxies and the Unblocker (anti-bot bypass):

proxy_poolWhat it runs
basicdatacenter proxies, Unblocker off
unblockerresidential proxies, Unblocker on
unblocker_ultraresidential proxies, Unblocker on, the only pool accepted by targets and anti-bot protections that have a price of their own
autothe API picks the pool before the request, from the target's profile: the Unblocker on datacenter proxies, or the pool the target needs; priced as the pool it runs on

Pick the pool a site needs: basic where datacenter proxies get through, unblocker or unblocker_ultra where it needs residential proxies and the Unblocker, auto to let the API pick. A target or an anti-bot protection with a price of its own refuses basic and unblocker with ERR::PROXY::UNBLOCKER_ULTRA_REQUIRED (HTTP 422, not billed): resend with proxy_pool=unblocker_ultra, or with proxy_pool=auto, which is accepted on every target, the ones that require unblocker_ultra included, where their price is added. public_tor_pool runs on the Tor network (.onion).

Deprecated: unblocker and asp

The unblocker input of web_scrape and its former name asp are deprecated: use proxy_pool (unblocker_ultra for the Unblocker). The migration guide covers requests written before the proxy pools, the pool names public_datacenter_pool and public_residential_pool included. Without a proxy_pool, the server sends the API no pool and, by default, asp=true, a request the guide covers as well.

Example: Scrape a Page

User: "What are the top posts on Hacker News right now?"
AI: Uses web_get_page to fetch https://news.ycombinator.com and returns current top stories

Example: Extract Structured Data

User: "Get all product prices from this Amazon page"
AI: Uses web_scrape with extraction_model="product_listing" to return structured JSON

📖 More examples: Real-World Examples


🔐 Authentication

Scrapfly MCP supports multiple authentication methods:

MethodBest ForDocumentation
OAuth2Production, multi-user appsOAuth2 Setup
API KeyPersonal use, developmentAPI Key Setup
Header AuthCustom integrationsHeader Auth

🔑 Get your API key: Scrapfly Dashboard


📊 Configuration Reference

SettingValue
Server Namescrapfly-cloud-mcp
TypeRemote HTTP Server
URLhttps://mcp.scrapfly.io/mcp
ProtocolMCP over HTTP/SSE

🖥️ Self-Hosted / Local Deployment

You can run the Scrapfly MCP server locally or self-host it.

CLI Arguments

FlagDescription
-http <address>Start HTTP server at the specified address (e.g., :8080). Takes precedence over PORT env var. In server-key mode this binds loopback (127.0.0.1) unless you also pass -allow-remote.
-apikey <key>Use this API key instead of the SCRAPFLY_API_KEY environment variable.
-allow-remoteServer-key HTTP mode only: permit binding a non-loopback interface. That mode performs no per-caller authentication — every request uses the baked-in key — so only enable this behind your own auth proxy.
-verify-sslVerify TLS certificates on outbound calls (default true). Set false only when targeting a host that serves a self-signed certificate.

Environment Variables

VariableDescription
PORTHTTP port to listen on. Used if -http flag is not set.
SCRAPFLY_API_KEYScrapfly API key baked into the server. When set, the server uses it for every request (server-key mode) and does not read a per-request key.
SCRAPFLY_ALLOW_REMOTE1/true is the env equivalent of -allow-remote.
SCRAPFLY_VERIFY_SSL0/false is the env equivalent of -verify-ssl=false.

Per-request key: start the server without a baked-in key (-http only) and each caller supplies their own key per request — as Authorization: Bearer <key>, or ?key=<key> / ?apiKey=<key>. This path is authenticated; the server-key path above is not, which is why it stays on loopback by default.

Examples

bash
# Start HTTP server on port 8080./scrapfly-mcp -http :8080
# Start HTTP server using PORT env varPORT=8080 ./scrapfly-mcp
# Start with an API key. Prefer the environment variable: a key passed as a# flag lands in your shell history and in the process list.# Server-key mode has no per-caller auth, so it binds 127.0.0.1 here.SCRAPFLY_API_KEY=... ./scrapfly-mcp -http :8080
# Same, but expose it on all interfaces — only behind your own auth proxy.SCRAPFLY_API_KEY=... ./scrapfly-mcp -http 0.0.0.0:8080 -allow-remote
# Start in stdio mode (for local MCP clients)./scrapfly-mcp

Docker

bash
# Builddocker build -t scrapfly-mcp .
# Run (Smithery compatible - uses PORT env var)docker run -p 8080:8080 scrapfly-mcp
# Run with custom portdocker run -e PORT=9000 -p 9000:9000 scrapfly-mcp

🤝 Framework Integrations

Scrapfly MCP also works with AI frameworks and automation tools:

📖 All integrations: Integration Index


📚 Resources


💬 Need Help?


[Scrapfly]
Made with ❤️ by Scrapfly
The Web Scraping API for Developers

來源:README.md,提交 1532d43

工具

0
SourceWeft 尚未在沙箱中啟動過該軟體包,因此其工具未知。

版本歷史

1
  1. v1.0.0最新Sep 16, 2026

評分

已滿足適用檢查項的 40%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分

    請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。

  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。

  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分

    請在儲存庫或註冊中心條目中宣告授權條款。