GenPark Bloom Filter URL Dedup Crawler

io.github.alphaparkincPublished by GitHub account alphaparkincv1.0.1Updated Nov 4, 2026

In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler inge

The publisher's own server: Bloom

VerifiedSTDIODesktop onlyWeb Search & Scraping

Overview

AI-generated overview

Local MCP server providing an in-memory Bloom filter so an assistant can deduplicate URLs and document hashes before re-crawling.

What you can do
  • Provides an in-memory Bloom filter for URL and document-hash deduplication.
  • Lets an assistant check whether a URL or hash was already seen before queueing it for crawling.
  • Helps avoid redundant crawler ingestion of pages already processed.
  • No tool list is published, so exact operations are not documented.
When to use it
Useful when building or running a web crawler and you want the assistant to skip URLs or documents it has already processed, keeping crawl queues free of duplicates.
Requirements
Runs as a local process on the user's machine via an MCPB package; desktop client only, no web execution. No authentication, environment variables or headers are declared.
Before you install
The filter is in-memory, so its state is likely lost when the process restarts and deduplication may reset. No tool list or README is published, so behavior is not documented; review the package before installing.

Installation

In SourceWeft

  1. Open GenPark Bloom Filter URL Dedup Crawler in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

README

This repository has no README.

Tools

0
SourceWeft started this package once in an isolated sandbox, without credentials, to list its tools. That failed: the package type cannot run in the sandbox.

Version history

1
  1. v1.0.1LatestOct 21, 2026

Score

25% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 days25 pts

    Keep the endpoint answering the MCP handshake; SourceWeft probes it every 30 days.

  • Auth declared10 pts

    Declare the credential headers in the registry entry, or keep the endpoint answering the probe so its auth can be classified.

  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • License10 pts

    Declare a license in the repository or the registry entry.

Other Bloom integrations