
Scrapeless Mcp Server
io.github.scrapeless-ai由 GitHub 账号 scrapeless-ai 发布v0.6.4更新于 Oct 24, 2026
Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
概览
Scrapeless MCP 服务器让助手通过 Scrapeless 进行 Google 搜索、操作云端浏览器、抓取与爬取网页,并创建 AI 抓取任务。
- 可以做什么
- 搜索 Google 并读取 Google Trends 的关键词与热度趋势数据。操作云端浏览器会话:导航、点击、输入、按键、滚动、等待、截图,并读取页面 HTML 或可见文本。将单个网址抓取为 HTML、Markdown 或截图。启动、轮询和取消按链接遍历网站的异步爬取任务。为 ChatGPT、Gemini、Perplexity、Copilot、Grok 或 Google AI Mode 等引擎创建 AI 抓取任务。
- 适用场景
- 当助手需要实时网页数据、JavaScript 渲染较重的页面、搜索结果或多页爬取,并希望由托管服务处理浏览器会话与反封锁,而不是依赖本地工具时适用。
- 运行要求
- 需要 Scrapeless 账号和 API 密钥:本地 npm 包(npx scrapeless-mcp-server)通过环境变量 SCRAPELESS_API_KEY 传入,托管端点通过请求头 x-api-token 传入。需要能访问 Scrapeless 服务的网络。可通过环境变量或请求头设置可选的浏览器配置与会话超时。
安装
在 SourceWeft 中
- 打开 控制台中的 Scrapeless Mcp Server,将其添加到工作区。
- 连接 x-api-token 凭据。它们会被私密存储,绝不会在公开页面上展示。
- 为需要使用其工具的对话启用该服务。
Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。
交给智能体安装
把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。
阅读 https://sourceweft.com/mcp/io.github.scrapeless-ai%2Fscrapeless-mcp-server/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。其他 MCP 客户端
把它添加到你客户端的 mcpServers 配置中。
{
"mcpServers": {
"scrapeless": {
"type": "http",
"url": "https://api.scrapeless.com/mcp",
"headers": {
"x-api-token": "<YOUR_API_KEY>"
}
}
}
}README
[preview]
Scrapeless MCP Server
Welcome to the official Scrapeless Model Context Protocol (MCP) Server — a powerful integration layer that empowers LLMs, AI Agents, and AI applications to interact with the web in real time.
Built on the open MCP standard, Scrapeless MCP Server seamlessly connects models like ChatGPT, Claude, and tools like Cursor and Windsurf to a wide range of external capabilities, including:
- Google services integration (Search, Trends)
- Browser automation for page-level navigation and interaction
- Scrape dynamic, JS-heavy sites—export as HTML, Markdown, or screenshots
- Crawl entire websites by following links and capture each page in multiple formats
- AI Scraper Create an AI Scraper task for ChatGPT, Gemini, Perplexity, Copilot, Google AI Mode, Google AI Overview, Grok, or Alexa
Whether you're building an AI research assistant, a coding copilot, or autonomous web agents, this server provides the dynamic context and real-world data your workflows need—without getting blocked.
Usage Examples
- Automated Web Interaction and Data Extraction with Claude
Using Scrapeless MCP Browser, Claude can perform complex tasks such as web navigation, clicking, scrolling, and scraping through conversational commands, with real-time preview of web interaction results via live sessions.
[preview]
- Bypassing Cloudflare to Retrieve Target Page Content
Using the Scrapeless MCP Browser service, the Cloudflare page is automatically accessed, and after the process is completed, the page content is extracted and returned in Markdown format.
[preview]
- Extracting Dynamically Rendered Page Content and Writing to File
Using the Scrapeless MCP Universal API, the JavaScript-rendered content of the target page above is scraped, exported in Markdown format, and finally written to a local file named text.md.
[preview]
- Automated SERP Scraping
Using the Scrapeless MCP Server, query the keyword “web scraping” on Google Search, retrieve the first 10 search results (including title, link, and summary), and write the content to the file named serp.text.
[preview]
Here are some additional examples of how to use these servers:
Setup Guide
- Get Scrapeless Key
- Log in to the Scrapeless Dashboard(Free trial available)
- Then click "Setting" on the left -> select "API Key Management" -> click "Create API Key". Finally, click the API Key you created to copy it.
[preview]
- Configure Your MCP Client
Scrapeless MCP Server supports both Stdio and Streamable HTTP transport modes.
🖥️ Stdio (Local Execution)
🌐 Streamable HTTP (Hosted API Mode)
Advanced Options
Customize browser session behavior with optional parameters. These can be set via environment variables (for Stdio) or HTTP headers (for Streamable HTTP):
Integration with Claude Desktop
- Open Claude Desktop
- Navigate to:
Settings→Tools→MCP Servers - Click "Add MCP Server"
- Paste either the
StdioorStreamable HTTPconfig above - Save and enable the server
- Claude will now be able to issue web queries, extract content, and interact with pages using Scrapeless
Integration with Cursor IDE
- Open Cursor
- Press
Cmd + Shift + Pand search for:Configure MCP Servers - Add the Scrapeless MCP config using the format above
- Save the file and restart Cursor (if needed)
- Now you can ask Cursor things like:
"Search StackOverflow for a solution to this error""Scrape the HTML from this page"
- And it will use Scrapeless in the background.
Supported MCP Tools
Security Best Practices
When using Scrapeless MCP Server with LLMs (like ChatGPT, Claude, or Cursor), it's critical to handle all scraped or extracted web content with care. Web data is untrusted by default, and improper handling may expose your application to prompt injection or other security vulnerabilities.
✅ Recommended Practices
- Never pass raw scraped content directly into LLM prompts. Raw HTML, JavaScript, or user-generated text may contain hidden injection payloads.
- Sanitize and validate all extracted content. Strip or escape potentially harmful tags and scripts before using content in downstream logic or AI models.
- Prefer structured extraction to free-form text. Use tools like
scrape_html,scrape_markdown, or targetedbrowser_get_textwith known-safe selectors to extract only the content you trust. - Apply domain or selector whitelisting when scraping dynamically generated pages, to restrict data flow to known and trusted sources.
- Log and monitor all outbound requests made via browser or scraping tools, especially if you're handling sensitive data, tokens, or internal network access.
🚫 Avoid
- Injecting scraped HTML directly into prompts
- Letting users specify arbitrary URLs or CSS selectors without validation
- Storing unfiltered scraped content for future prompt usage
Community
Contact Us
For questions, suggestions, or collaboration inquiries, feel free to contact us via:
- Email: [email protected]
- Official Website: https://www.scrapeless.com
- Community Forum: https://discord.gg/Np4CAHxB9a
来源:README.md,提交 c5e0964
工具
0版本历史
1- v0.6.4最新Sep 16, 2026
评分
已满足适用检查项的 85%
该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。
- 近 30 天内可连通必需25 分
- 已声明认证方式必需10 分
- 已列出工具15 分
请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。
- 描述必需15 分
- 图标10 分
- 文档15 分
- 许可证10 分