Scrapeless Mcp Server

io.github.scrapeless-ai由 GitHub 账号 scrapeless-ai 发布v0.6.4更新于 Oct 24, 2026

Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.

已验证Streamable HTTP可网页运行网页搜索与抓取浏览器自动化

概览

AI 生成的概览

Scrapeless MCP 服务器让助手通过 Scrapeless 进行 Google 搜索、操作云端浏览器、抓取与爬取网页,并创建 AI 抓取任务。

可以做什么
搜索 Google 并读取 Google Trends 的关键词与热度趋势数据。操作云端浏览器会话:导航、点击、输入、按键、滚动、等待、截图,并读取页面 HTML 或可见文本。将单个网址抓取为 HTML、Markdown 或截图。启动、轮询和取消按链接遍历网站的异步爬取任务。为 ChatGPT、Gemini、Perplexity、Copilot、Grok 或 Google AI Mode 等引擎创建 AI 抓取任务。
适用场景
当助手需要实时网页数据、JavaScript 渲染较重的页面、搜索结果或多页爬取,并希望由托管服务处理浏览器会话与反封锁,而不是依赖本地工具时适用。
运行要求
需要 Scrapeless 账号和 API 密钥:本地 npm 包(npx scrapeless-mcp-server)通过环境变量 SCRAPELESS_API_KEY 传入,托管端点通过请求头 x-api-token 传入。需要能访问 Scrapeless 服务的网络。可通过环境变量或请求头设置可选的浏览器配置与会话超时。
安装前请注意
API 密钥是计费服务的凭据;虽提到免费试用,但使用可能产生费用。浏览器与抓取工具会把目标网址和页面数据发送给 Scrapeless。抓取的网页内容不可信,可能包含提示注入,应避免将原始 HTML 直接放入提示,并校验用户提供的网址与选择器。启用后浏览器会话可能保留 Cookie 和本地存储。

安装

在 SourceWeft 中

  1. 打开 控制台中的 Scrapeless Mcp Server,将其添加到工作区。
  2. 连接 x-api-token 凭据。它们会被私密存储,绝不会在公开页面上展示。
  3. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.github.scrapeless-ai%2Fscrapeless-mcp-server/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "scrapeless": {
      "type": "http",
      "url": "https://api.scrapeless.com/mcp",
      "headers": {
        "x-api-token": "<YOUR_API_KEY>"
      }
    }
  }
}

README

[preview]

Scrapeless MCP Server

Welcome to the official Scrapeless Model Context Protocol (MCP) Server — a powerful integration layer that empowers LLMs, AI Agents, and AI applications to interact with the web in real time.

Built on the open MCP standard, Scrapeless MCP Server seamlessly connects models like ChatGPT, Claude, and tools like Cursor and Windsurf to a wide range of external capabilities, including:

  • Google services integration (Search, Trends)
  • Browser automation for page-level navigation and interaction
  • Scrape dynamic, JS-heavy sites—export as HTML, Markdown, or screenshots
  • Crawl entire websites by following links and capture each page in multiple formats
  • AI Scraper Create an AI Scraper task for ChatGPT, Gemini, Perplexity, Copilot, Google AI Mode, Google AI Overview, Grok, or Alexa

Whether you're building an AI research assistant, a coding copilot, or autonomous web agents, this server provides the dynamic context and real-world data your workflows need—without getting blocked.

Usage Examples

  1. Automated Web Interaction and Data Extraction with Claude

Using Scrapeless MCP Browser, Claude can perform complex tasks such as web navigation, clicking, scrolling, and scraping through conversational commands, with real-time preview of web interaction results via live sessions.

[preview]

  1. Bypassing Cloudflare to Retrieve Target Page Content

Using the Scrapeless MCP Browser service, the Cloudflare page is automatically accessed, and after the process is completed, the page content is extracted and returned in Markdown format.

[preview]

  1. Extracting Dynamically Rendered Page Content and Writing to File

Using the Scrapeless MCP Universal API, the JavaScript-rendered content of the target page above is scraped, exported in Markdown format, and finally written to a local file named text.md.

[preview]

  1. Automated SERP Scraping

Using the Scrapeless MCP Server, query the keyword “web scraping” on Google Search, retrieve the first 10 search results (including title, link, and summary), and write the content to the file named serp.text.

[preview]

Here are some additional examples of how to use these servers:

Example
Search scrapeless by Google search.
Find the search interest for "AI" over the last year.
Use a browser to visit chatgpt.com, search for "What's the weather like today?", and summarize the results.
Scrape the HTML content of scrapeless.com page.
Scrape the Markdown content of scrapeless.com page.
Get screenshots of scrapeless.com.

Setup Guide

  1. Get Scrapeless Key
  • Log in to the Scrapeless Dashboard(Free trial available)
  • Then click "Setting" on the left -> select "API Key Management" -> click "Create API Key". Finally, click the API Key you created to copy it.

[preview]

  1. Configure Your MCP Client

Scrapeless MCP Server supports both Stdio and Streamable HTTP transport modes.

🖥️ Stdio (Local Execution)

JSON
{  "mcpServers": {    "Scrapeless MCP Server": {      "command": "npx",      "args": ["-y", "scrapeless-mcp-server"],      "env": {        "SCRAPELESS_API_KEY": "YOUR_SCRAPELESS_KEY"      }    }  }}

🌐 Streamable HTTP (Hosted API Mode)

JSON
{  "mcpServers": {    "Scrapeless MCP Server": {      "type": "streamable-http",      "url": "https://api.scrapeless.com/mcp",      "headers": {        "x-api-token": "YOUR_SCRAPELESS_KEY"      },      "disabled": false,      "alwaysAllow": []    }  }}
Advanced Options

Customize browser session behavior with optional parameters. These can be set via environment variables (for Stdio) or HTTP headers (for Streamable HTTP):

Stdio (Env Var)Streamable HTTP (HTTP Header)Description
BROWSER_PROFILE_IDx-browser-profile-idSpecifies a reusable browser profile ID for session continuity.
BROWSER_PROFILE_PERSISTx-browser-profile-persistEnables persistent storage for cookies, local storage, etc.
BROWSER_SESSION_TTLx-browser-session-ttlDefines the maximum session timeout in seconds. The session will automatically expire after this duration of inactivity.

Integration with Claude Desktop

  1. Open Claude Desktop
  2. Navigate to: Settings → Tools → MCP Servers
  3. Click "Add MCP Server"
  4. Paste either the Stdio or Streamable HTTP config above
  5. Save and enable the server
  6. Claude will now be able to issue web queries, extract content, and interact with pages using Scrapeless

Integration with Cursor IDE

  1. Open Cursor
  2. Press Cmd + Shift + P and search for: Configure MCP Servers
  3. Add the Scrapeless MCP config using the format above
  4. Save the file and restart Cursor (if needed)
  5. Now you can ask Cursor things like:
    1. "Search StackOverflow for a solution to this error"
    2. "Scrape the HTML from this page"
  6. And it will use Scrapeless in the background.

Supported MCP Tools

NameDescription
google_searchUniversal information search engine.
google_trendsGet trending search data from Google Trends.
browser_createCreate or reuse a cloud browser session using Scrapeless.
browser_closeCloses the current session by disconnecting the cloud browser.
browser_gotoNavigate browser to a specified URL.
browser_go_backGo back one step in browser history.
browser_go_forwardGo forward one step in browser history.
browser_clickClick a specific element on the page.
browser_typeType text into a specified input field.
browser_press_keySimulate a key press.
browser_wait_forWait for a specific page element to appear.
browser_waitPause execution for a fixed duration.
browser_screenshotCapture a screenshot of the current page.
browser_get_htmlGet the full HTML of the current page.
browser_get_textGet all visible text from the current page.
browser_scrollScroll to the bottom of the page.
browser_scroll_toScroll a specific element into view.
scrape_htmlScrape a URL and return its full HTML content.
scrape_markdownScrape a URL and return its content as Markdown.
scrape_screenshotCapture a high-quality screenshot of any webpage.
crawl_startStart an asynchronous crawl job from a base URL and return its job id.
crawl_cancelCancel an in-progress crawl job by its id.
crawl_resultPoll a crawl job by its id until it completes and return the crawled data.
ai_scraperCreate an AI Scraper task for ChatGPT, Gemini, Perplexity, Copilot, Google AI Mode, Google AI Overview, Grok, or Alexa.

Security Best Practices

When using Scrapeless MCP Server with LLMs (like ChatGPT, Claude, or Cursor), it's critical to handle all scraped or extracted web content with care. Web data is untrusted by default, and improper handling may expose your application to prompt injection or other security vulnerabilities.

✅ Recommended Practices
  • Never pass raw scraped content directly into LLM prompts. Raw HTML, JavaScript, or user-generated text may contain hidden injection payloads.
  • Sanitize and validate all extracted content. Strip or escape potentially harmful tags and scripts before using content in downstream logic or AI models.
  • Prefer structured extraction to free-form text. Use tools like scrape_html, scrape_markdown, or targeted browser_get_text with known-safe selectors to extract only the content you trust.
  • Apply domain or selector whitelisting when scraping dynamically generated pages, to restrict data flow to known and trusted sources.
  • Log and monitor all outbound requests made via browser or scraping tools, especially if you're handling sensitive data, tokens, or internal network access.
🚫 Avoid
  • Injecting scraped HTML directly into prompts
  • Letting users specify arbitrary URLs or CSS selectors without validation
  • Storing unfiltered scraped content for future prompt usage

Community

Contact Us

For questions, suggestions, or collaboration inquiries, feel free to contact us via:

来源:README.md,提交 c5e0964

工具

0
该服务器需要 API 密钥等凭据,因此 SourceWeft 无法在没有凭据的情况下读取其工具,也未收录。

版本历史

1
  1. v0.6.4最新Sep 16, 2026

评分

已满足适用检查项的 85%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分