
Scrapfly
io.scrapfly.mcp由 mcp.scrapfly.io 发布v1.0.0更新于 Oct 26, 2026
Scrape any website, extract structured data, and collect web content at scale with AI agents
概览
Scrapfly MCP 让助手实时访问网页:抓取页面、提取结构化数据、截图,并操作云端浏览器会话。
- 可以做什么
- 抓取与采集网页,支持 JS 渲染、代理池与国家定位,并可一次性截图和判断是否被拦截
- 从复杂网站提取结构化 JSON,并查询账户套餐、额度用量与当前 API 密钥信息
- 开启并管理有状态的云端浏览器会话,包括反爬绕过、导航、下载文件与性能测试
- 与已打开的会话交互:快照、点击、输入、滚动、执行脚本与查找元素
- 管理用于登录的凭据保险库(可选从 1Password 同步),并创建、测试或暂停账户指标告警规则
- 适用场景
- 当助手需要训练数据之外的实时网页内容时适用,例如价格、商品列表、新闻,或需要 JavaScript 渲染和反爬绕过的页面。也适合通过截图做视觉检查,以及登录等多步浏览器流程。
- 运行要求
- 需要 Scrapfly 账户与 API 密钥,或在托管远程端点上使用 OAuth2 登录。托管服务无需安装;本地运行需 npm 包或自托管二进制/Docker 镜像,并通过 SCRAPFLY_API_KEY 或每次请求的 Bearer 密钥认证。需要能访问 Scrapfly 的网络。
安装
在 SourceWeft 中
- 打开 控制台中的 Scrapfly,将其添加到工作区。
- 为需要使用其工具的对话启用该服务。
Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。
其他 MCP 客户端
参照 仓库 中的启动说明。
README
Scrapfly MCP Server
Give your AI real-time access to any website
🌐 Landing Page • 📖 Documentation • 🎮 Live Demo • 🔑 Get API Key
At a glance
Add it to any MCP client:
Tools that fetch pages need no setup beyond the key: web_get_page (quick fetch), web_scrape (full control: JS rendering, proxy pool, country, extraction) and screenshot.
What is Scrapfly MCP?
The Scrapfly MCP Server connects your AI assistants to live web data through the Model Context Protocol. Transform your AI from being limited by training data to having real-time access to any website.
✨ What Your AI Can Do
🏆 Why Scrapfly?
Built on battle-tested infrastructure used by thousands of developers:
- 99.9% Uptime — Enterprise-grade reliability
- 100+ Countries — Global proxy network with datacenter & residential IPs, in three proxy pools (Basic, Unblocker, Unblocker Ultra) or Auto, where the API picks the pool
- Anti-Bot Bypass — Advanced Unblocker technology defeats modern protections
- OAuth2 Security — Enterprise authentication for production deployments
📖 Learn more: Why Scrapfly MCP?
🚀 Quick Install
Click one of the buttons below to install the MCP server in your preferred IDE:
[Install in VS Code] [Install in VS Code Insiders] [Install in Visual Studio] [Install in Cursor]
📦 Manual Installation
Standard Configuration
Works with most MCP-compatible tools:
Cloud Configuration (NPX)
For tools that require a local process:
🔧 IDE-Specific Setup
VS Code
One-Click Install
Manual Install
Follow the VS Code MCP guide or use the CLI:
After installation, Scrapfly tools will be available in GitHub Copilot Chat.
📖 Full guide: VS Code Integration
Visual Studio
One-Click Install
Manual Install
- Open Visual Studio
- Navigate to GitHub Copilot Chat window
- Click the tools icon (🛠️) in the chat toolbar
- Click + Add Server to open the configuration dialog
- Configure:
- Server ID:
scrapfly-cloud-mcp - Type:
http/sse - URL:
https://mcp.scrapfly.io/mcp
- Server ID:
- Click Save
📖 Full guide: Visual Studio MCP documentation
Cursor
One-Click Install
Manual Install
- Go to
Cursor Settings→MCP→Add new MCP Server - Use the standard configuration above
- Click Edit to verify or add arguments
📖 Full guide: Cursor Integration
Claude Desktop
Add to your Claude Desktop configuration file:
macOS: ~/Library/Application Support/Claude/claude_desktop_config.json
Windows: %APPDATA%\Claude\claude_desktop_config.json
📖 Full guide: Claude Desktop Integration
Windsurf
Follow the Windsurf MCP documentation using the standard configuration.
📖 Full guide: Windsurf Integration
Gemini CLI
Follow the Gemini CLI MCP guide using the standard configuration.
🛠️ Available Tools
The Scrapfly MCP Server exposes 62 tools in seven groups. Most tasks need only the first group.
Web scraping (5)
Stateless, one call per page.
Account (2)
Cloud Browser sessions (9)
A stateful real browser, kept between calls.
Page interaction (17)
Act on the open Cloud Browser session. Elements are addressed by the uid that take_snapshot returns.
take_snapshot, take_screenshot, find_elements, get_page_url, evaluate_script, click, hover, drag, fill, type_text, press_key, select_option, dropdown_options, scroll, scroll_to_text, go_back, wait
WebMCP (2)
For pages that register their own tools with navigator.modelContext.
list_webmcp_tools, call_webmcp_tool
Credential vaults (15)
Store logins for Cloud Browser sessions, optionally mirrored from 1Password.
cloud_browser_vault_create, cloud_browser_vault_list, cloud_browser_vault_get, cloud_browser_vault_update, cloud_browser_vault_delete, cloud_browser_vault_rotate, cloud_browser_vault_item_create, cloud_browser_vault_item_list, cloud_browser_vault_item_update, cloud_browser_vault_item_delete, cloud_browser_vault_service_link, cloud_browser_vault_service_update, cloud_browser_vault_service_sync, cloud_browser_vault_service_test, cloud_browser_vault_service_unlink
Alerts (12)
Create, test and snooze alert rules on your account metrics. Writes take a confirm step.
alert_metric_families, alert_preview, alert_create, alert_update, alert_delete, alert_get, alert_list, alert_count_active, alert_series, alert_test, alert_snooze, alert_unsnooze
📖 Full reference: Tools & API Specification
Proxy pools
web_scrape and web_get_page take a proxy_pool, which sets both the proxies and the Unblocker
(anti-bot bypass):
Pick the pool a site needs: basic where datacenter proxies get through, unblocker or
unblocker_ultra where it needs residential proxies and the Unblocker, auto to let the API pick.
A target or an anti-bot protection with a price of its own refuses basic and unblocker with
ERR::PROXY::UNBLOCKER_ULTRA_REQUIRED (HTTP 422, not billed): resend with
proxy_pool=unblocker_ultra, or with proxy_pool=auto, which is accepted on every target, the ones
that require unblocker_ultra included, where their price is added. public_tor_pool runs on the
Tor network (.onion).
Deprecated: unblocker and asp
The unblocker input of web_scrape and its former name asp are deprecated: use proxy_pool
(unblocker_ultra for the Unblocker). The
migration guide covers requests written before
the proxy pools, the pool names public_datacenter_pool and public_residential_pool included.
Without a proxy_pool, the server sends the API no pool and, by default, asp=true, a request the
guide covers as well.
Example: Scrape a Page
Example: Extract Structured Data
📖 More examples: Real-World Examples
🔐 Authentication
Scrapfly MCP supports multiple authentication methods:
🔑 Get your API key: Scrapfly Dashboard
📊 Configuration Reference
🖥️ Self-Hosted / Local Deployment
You can run the Scrapfly MCP server locally or self-host it.
CLI Arguments
Environment Variables
Per-request key: start the server without a baked-in key (-http only) and
each caller supplies their own key per request — as Authorization: Bearer <key>,
or ?key=<key> / ?apiKey=<key>. This path is authenticated; the server-key
path above is not, which is why it stays on loopback by default.
Examples
Docker
🤝 Framework Integrations
Scrapfly MCP also works with AI frameworks and automation tools:
📖 All integrations: Integration Index
📚 Resources
- 🌐 MCP Cloud Landing Page — Product overview & features
- 🎮 Live n8n Demo — Try it in your browser
- 📖 Full Documentation
- 🛠️ Tools Reference
- 💡 Examples & Use Cases
- ❓ FAQ
- 🔐 Authentication Guide
💬 Need Help?
[Scrapfly]
Made with ❤️ by Scrapfly
The Web Scraping API for Developers
来源:README.md,提交 1532d43
工具
0版本历史
1- v1.0.0最新Sep 16, 2026
评分
已满足适用检查项的 40%
该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。
- 近 30 天内可连通25 分
请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。
- 已声明认证方式10 分
请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。
- 已列出工具15 分
请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。
- 描述必需15 分
- 图标10 分
- 文档15 分
- 许可证10 分
请在仓库或注册中心条目中声明许可证。