Web Scraping Mcp Server

com.thenextgennexusPublished by thenextgennexus.comv1.0.1Updated Nov 8, 2026

Website crawling, Google search and Wikipedia lookup as agent tools.

VerifiedStreamable HTTPWeb executableWeb Search & Scraping

Overview

AI-generated overview

Lets an assistant crawl a URL and extract HTML content from web pages, as a fallback for sites without dedicated MCP servers.

What you can do
This remote MCP server provides generic URL crawling and HTML extraction. It is described as a fallback for sites that do not have a dedicated MCP server, so an assistant can fetch a page and pull structured content from its HTML. No individual tools are listed in the manifest, so the exact tool names and parameters are not documented here.
When to use it
Use it when an assistant needs to read or extract content from a website that has no purpose-built MCP integration, and a generic crawl-and-extract step is enough. It is a general fallback rather than a site-specific connector.
Requirements
A remote streamable HTTP endpoint; no local package or runtime is declared. Authentication is required via OAuth, with an Authorization header carrying an Apify API token. The provider notes a free tier at console.apify.com. Network access to the remote endpoint is needed.
Before you install
The Authorization header carries an Apify API token, which is a secret; treat it as a credential and avoid exposing it. Crawling sends the target URLs to a third-party remote service, so consider whether the pages you request are sensitive. The manifest lists no tools, so review the server's actual behavior before relying on it.

Installation

In SourceWeft

  1. Open Web Scraping Mcp Server in the dashboard and add it to a workspace.
  2. Connect the required credentials. They are stored privately and never shown on public pages.
  3. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/com.thenextgennexus%2Fweb-scraping-mcp-server/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config. The client completes OAuth sign-in on first connect.

{
  "mcpServers": {
    "web-scraping": {
      "type": "http",
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Tools

0
This server asks you to sign in, so SourceWeft could not read its tools without an account and has not indexed them. What a connected account sees can depend on that account and its permissions.

Version history

1
  1. v1.0.0Sep 16, 2026

Score

67% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.