Mcp Site Crawler Links Tables

com.mambabuilt由 mambabuilt.com 發布v1.0.0更新於 Nov 7, 2026

Crawl a website for links, file download links, HTML tables as rows, and lists, with no AI

已驗證STDIO僅桌面網頁搜尋與抓取資料與分析

概覽

AI 產生的概覽

透過 Apify actor 爬取網站，依頁面回傳連結、下載連結、HTML 表格與清單的列資料。

可以做什麼
  • 從一個或多個起始網址爬取網站，跟隨連結並可選用 sitemap
  • 依頁面收集內部連結與外部連結，包括指向其他網域的連結
  • 依副檔名列出檔案下載連結，但不實際下載檔案
  • 把每個 HTML 表格與每個清單擷取為列
  • 以頁數上限、深度、僅同網域與 robots.txt 設定控制爬取範圍
適用情境
適合需要結構化盤點網站連結、可下載檔案、表格或清單的情境，例如稽核對外連結或從多個頁面擷取表格資料。由於不執行瀏覽器，不適合 JavaScript 渲染的頁面。
執行需求
以 npx 執行的本機程序，需要 Node.js 18 或更新版本。需要 Apify 帳號，並透過環境變數 APIFY_TOKEN 提供 Apify API 權杖；沒有權杖時仍會列出工具，但呼叫時需要權杖。需要連線至 Apify 的網路。
安裝前請注意
執行依事件計費並計入你的 Apify 帳號（頁面列、住宅代理頁面列、下載連結列、actor 啟動），爬取大型網站或使用住宅代理會產生費用，可用 max_charge_usd 設上限。APIFY_TOKEN 是機密憑證。爬取會把目標網址傳送給 Apify；obey_robots 可被關閉，僅應在你有權這樣做時關閉。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Mcp Site Crawler Links Tables，將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only，透過 STDIO。 STDIO 服務會啟動本機處理程序，因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

Site Crawler for Links and Tables MCP Server

[npm version] [license]

An MCP server for the Mamba Labs Site Crawler for Links and Tables actor on Apify. Crawl a website and get its links, download links, tables, and lists as rows.

What's Inside

What it does

Give a start address. The actor crawls the site over plain HTTP, following links and the sitemap, and returns one row per page with internal links, external links, file download links, every HTML table as rows, and every list. The output is deterministic, with no AI. robots.txt is obeyed by default. Pages built by JavaScript return little, because no browser runs.

All of the work runs on Apify. This package is a thin client that starts the actor run, waits for it, and hands back the dataset rows.

Quick start

You need Node.js 18 or newer and an Apify account with an API token.

Add this to your Claude Desktop config (claude_desktop_config.json), Cursor, or any MCP client:

json
{  "mcpServers": {    "mamba-site-crawler-links-tables": {      "command": "npx",      "args": [        "-y",        "@mambalabsdev/mcp-site-crawler-links-tables"      ],      "env": {        "APIFY_TOKEN": "your-apify-token"      }    }  }}

Restart the client. The crawl_site_links_tables tool appears.

Prerequisites

Example prompts

  • "List every external download link on this website."
  • "Pull all the tables from these pages into rows."
  • "Crawl this site and show me which pages link out to other domains."

Tool

crawl_site_links_tables. One tool. Example arguments:

json
{  "start_urls": [    "https://webscraper.io/test-sites/tables"  ],  "extract": [    "tables",    "links"  ],  "max_pages": 10,  "max_depth": 1}

Inputs

Every buyer facing input of the actor. Omitted inputs take the actor's own defaults.

InputTypeRequiredDescription
start_urlsarraynoWeb addresses to start from, up to 100. A bare domain such as example.com is read as https.
max_pagesnumbernoPages to read across the whole run, up to 10,000. Default 100.
max_depthnumbernoHow many links to follow from a start address. 0 reads only the start address. Default 10.
same_domain_onlystringnoyes (default): follow links only on the start address's host and its subdomains. no: also follow links to other sites, up to Maximum pages. Links to other sites are listed either way.
extractarraynoAny of links, tables, lists, download_links. Default links, tables, lists. download_links adds one separate row per file link, charged as download-link-row; the download_links field on page rows is always filled at no extra charge.
download_extensionsarraynoFile extensions that count as download links. Default pdf, zip, xlsx, xls, docx, doc, pptx, csv, mp3, mp4, exe, dmg, msi, pkg, gz, tar, tgz, 7z, rar, iso, apk. Files are listed, never downloaded.
use_sitemapstringnoyes (default): also queue the addresses in /sitemap.xml, which finds pages no link reaches. no: follow links only.
obey_robotsstringnoyes (default): skip pages robots.txt disallows and honor its crawl delay up to 5 seconds. no: read them, only if you have the right to.
max_charge_usdstringnoOptional. The run stops before a charge that would pass this amount. Summary rows are always returned.
proxy_modestringnopool (default): the Apify proxy pool only, charged as page-row; a page that refuses it gets a free blocked row. auto: a refused page is retried on residential addresses, and a page read that way is charged as residential-page-row. residential: every page uses residential addresses and is charged as residential-page-row.

Pricing

Pay per event on Apify, billed to your Apify account. Prices in USD.

EventFree planBronzeSilverGold
page-row, one page read on the proxy pool$0.006$0.0057$0.0054$0.0051
residential-page-row, one page read on residential addresses, only with proxy_mode auto or residential$0.02$0.019$0.018$0.017
download-link-row, one separate file link row, only when extract includes download_links$0.0001$0.000095$0.00009$0.000085
apify-actor-start, per run start$0.0055$0.0055$0.0055$0.0055

Failed or refused pages, summary rows, pages skipped by robots.txt, and refused input are free. Mamba Labs pays the platform costs of the run, Apify proxy traffic included. Mamba Labs pays the platform costs of the run, Apify proxy traffic included.

Full actor documentation

apify.com/mambalabs/site-crawler-links-tables

License

MIT. See LICENSE.

來源：README.md，提交 1504c1a

工具

0
SourceWeft 尚未在沙箱中啟動過該軟體包，因此其工具未知。

版本歷史

1
  1. v1.0.0最新Nov 7, 2026

評分

已滿足適用檢查項的 50%

該評分衡量此收錄條目的完整程度，依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價，也不表示伺服器安全或目前可用：可連通性是帶日期的檢查結果，評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分

    請保持端點能夠回應 MCP 握手；SourceWeft 每 30 天探測一次。

  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭，或保持端點能夠回應探測，以便判定其認證方式。

  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list，或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分