Mcp Site Crawler Links Tables

com.mambabuiltPublished by mambabuilt.comv1.0.0Updated Nov 7, 2026

Crawl a website for links, file download links, HTML tables as rows, and lists, with no AI

VerifiedSTDIODesktop onlyWeb Search & ScrapingData & Analytics

Overview

AI-generated overview

Crawls a website via an Apify actor and returns per-page rows of links, download links, HTML tables and lists.

What you can do
  • Crawl a site from one or more start addresses, following links and optionally the sitemap
  • Collect internal and external links per page, including links to other domains
  • List file download links by extension, without downloading the files
  • Extract every HTML table and every list as rows
  • Control crawl scope with page limits, depth, same-domain-only and robots.txt settings
When to use it
Useful when you need a structured inventory of a site's links, downloadable files, tables or lists, such as auditing outbound links or pulling tabular data from several pages. Not suitable for JavaScript-rendered pages, since no browser runs.
Requirements
Local process run with npx, requiring Node.js 18 or newer. An Apify account and an Apify API token supplied as the APIFY_TOKEN environment variable; the tool is listed without a token but calls need one. Network access to Apify.
Before you install
Runs are billed per event to your Apify account (page rows, residential page rows, download-link rows, actor start), so crawling large sites or using residential proxies costs money; max_charge_usd can cap a run. The APIFY_TOKEN is a secret credential. Crawling sends target URLs to Apify, and obey_robots can be turned off, which should only be done where you have the right to.

Installation

In SourceWeft

  1. Open Mcp Site Crawler Links Tables in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

README

Site Crawler for Links and Tables MCP Server

[npm version] [license]

An MCP server for the Mamba Labs Site Crawler for Links and Tables actor on Apify. Crawl a website and get its links, download links, tables, and lists as rows.

What's Inside

What it does

Give a start address. The actor crawls the site over plain HTTP, following links and the sitemap, and returns one row per page with internal links, external links, file download links, every HTML table as rows, and every list. The output is deterministic, with no AI. robots.txt is obeyed by default. Pages built by JavaScript return little, because no browser runs.

All of the work runs on Apify. This package is a thin client that starts the actor run, waits for it, and hands back the dataset rows.

Quick start

You need Node.js 18 or newer and an Apify account with an API token.

Add this to your Claude Desktop config (claude_desktop_config.json), Cursor, or any MCP client:

json
{  "mcpServers": {    "mamba-site-crawler-links-tables": {      "command": "npx",      "args": [        "-y",        "@mambalabsdev/mcp-site-crawler-links-tables"      ],      "env": {        "APIFY_TOKEN": "your-apify-token"      }    }  }}

Restart the client. The crawl_site_links_tables tool appears.

Prerequisites

Example prompts

  • "List every external download link on this website."
  • "Pull all the tables from these pages into rows."
  • "Crawl this site and show me which pages link out to other domains."

Tool

crawl_site_links_tables. One tool. Example arguments:

json
{  "start_urls": [    "https://webscraper.io/test-sites/tables"  ],  "extract": [    "tables",    "links"  ],  "max_pages": 10,  "max_depth": 1}

Inputs

Every buyer facing input of the actor. Omitted inputs take the actor's own defaults.

InputTypeRequiredDescription
start_urlsarraynoWeb addresses to start from, up to 100. A bare domain such as example.com is read as https.
max_pagesnumbernoPages to read across the whole run, up to 10,000. Default 100.
max_depthnumbernoHow many links to follow from a start address. 0 reads only the start address. Default 10.
same_domain_onlystringnoyes (default): follow links only on the start address's host and its subdomains. no: also follow links to other sites, up to Maximum pages. Links to other sites are listed either way.
extractarraynoAny of links, tables, lists, download_links. Default links, tables, lists. download_links adds one separate row per file link, charged as download-link-row; the download_links field on page rows is always filled at no extra charge.
download_extensionsarraynoFile extensions that count as download links. Default pdf, zip, xlsx, xls, docx, doc, pptx, csv, mp3, mp4, exe, dmg, msi, pkg, gz, tar, tgz, 7z, rar, iso, apk. Files are listed, never downloaded.
use_sitemapstringnoyes (default): also queue the addresses in /sitemap.xml, which finds pages no link reaches. no: follow links only.
obey_robotsstringnoyes (default): skip pages robots.txt disallows and honor its crawl delay up to 5 seconds. no: read them, only if you have the right to.
max_charge_usdstringnoOptional. The run stops before a charge that would pass this amount. Summary rows are always returned.
proxy_modestringnopool (default): the Apify proxy pool only, charged as page-row; a page that refuses it gets a free blocked row. auto: a refused page is retried on residential addresses, and a page read that way is charged as residential-page-row. residential: every page uses residential addresses and is charged as residential-page-row.

Pricing

Pay per event on Apify, billed to your Apify account. Prices in USD.

EventFree planBronzeSilverGold
page-row, one page read on the proxy pool$0.006$0.0057$0.0054$0.0051
residential-page-row, one page read on residential addresses, only with proxy_mode auto or residential$0.02$0.019$0.018$0.017
download-link-row, one separate file link row, only when extract includes download_links$0.0001$0.000095$0.00009$0.000085
apify-actor-start, per run start$0.0055$0.0055$0.0055$0.0055

Failed or refused pages, summary rows, pages skipped by robots.txt, and refused input are free. Mamba Labs pays the platform costs of the run, Apify proxy traffic included. Mamba Labs pays the platform costs of the run, Apify proxy traffic included.

Full actor documentation

apify.com/mambalabs/site-crawler-links-tables

License

MIT. See LICENSE.

Source: README.md at commit 1504c1a

Tools

0
SourceWeft has not started this package in its sandbox yet, so its tools are not known.

Version history

1
  1. v1.0.0LatestNov 7, 2026

Score

50% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 days25 pts

    Keep the endpoint answering the MCP handshake; SourceWeft probes it every 30 days.

  • Auth declared10 pts

    Declare the credential headers in the registry entry, or keep the endpoint answering the probe so its auth can be classified.

  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts