AI-First Scraper

io.github.yubinkim444Published by GitHub account yubinkim444v1.0.2Updated Oct 25, 2026

Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.

The publisher's own server: AI-first company: evidence on AI adoption

VerifiedSTDIODesktop onlyWeb Search & Scraping

Server details

Identifier: io.github.yubinkim444/ai-first-scraper-mcp
Transport: STDIO
Runtime: Desktop only
Trust: Verified
Published: Sep 16, 2026

Security note

MCP servers receive tool arguments from a conversation and may perform external actions. Review what a server can do before you enable it, and give it only the access it needs.

The registry verified the GitHub account yubinkim444 for this listing. That does not show the account is the product's maker.

SourceWeft's checks cover whether the listing is complete and the endpoint answered; they do not review the server's code or what its tools do.

Add a badge to your README

Show readers this MCP server is listed on SourceWeft. The badge links to this page.

[![Listed on SourceWeft](https://sourceweft.com/badge/mcp/io.github.yubinkim444%2Fai-first-scraper-mcp.svg)](https://sourceweft.com/mcp/io.github.yubinkim444%2Fai-first-scraper-mcp?utm_source=readme&utm_medium=badge)

Overview

AI-generated overview

A local MCP server that gives an assistant three tools to fetch web pages as clean Markdown and run web searches with results already converted to Markdown.

What you can do: Fetch a single URL and get back clean Markdown, for HTML or PDF pages, without ads or raw markup clutter. Fetch up to 25 URLs in parallel and receive Markdown for each. Run a web search and get the top results already converted to Markdown, ready to summarize or reason over.
When to use it: Useful when an assistant needs to read web pages or PDFs and search the web without handling raw HTML, for example research, article summaries, or gathering sources for a task.
Requirements: Runs locally over stdio, launched with uvx from the PyPI package ai-first-scraper-mcp or installed with pip. Needs network access to the default public scraper and search services, or to self-hosted backends set via SCRAPER_URL and SEARCH_URL. AFS_TIMEOUT sets the upstream HTTP timeout. No authentication is declared.

Before you install

By default all fetched URLs and search queries go to the public ai-first-scraper and ai-first-search services hosted on Render, so page content and queries leave your machine. Point SCRAPER_URL and SEARCH_URL at your own backends if that matters. The tools only read web content; no writes or credentials are involved.

Installation

In SourceWeft

Open AI-First Scraper in the dashboard and add it to a workspace.
Enable the server for the chats that should use its tools.

Desktop only via STDIO. STDIO servers start a local process, so they need the SourceWeft desktop host.

Other MCP clients

Follow the launch instructions in the repository.

README

ai-first-scraper-mcp

Plug Claude Desktop, Cursor, or Cline straight into an ad-free web scraper + search engine. Three tools, one line of config.

[PyPI] [Python] [MCP] [License: MIT]

What it does

Adds three tools to any MCP-compatible agent:

Tool	What it does
`fetch_page`	Fetch one URL → return clean Markdown (HTML or PDF).
`fetch_pages_batch`	Fetch up to 25 URLs in parallel → return Markdown for each.
`search_web`	Run a web search and return the top-k result pages already converted to Markdown.

No more "the model called curl and then tried to parse 80kB of ad HTML." Your agent receives clean Markdown ready to reason about.

Backed by the ai-first-scraper and ai-first-search APIs.

Install

Fastest — `uvx` (no install, runs from PyPI on demand)

jsonc

// claude_desktop_config.json  /  cline_mcp_settings.json  /  ~/.cursor/mcp.json{  "mcpServers": {    "ai-first-scraper": {      "command": "uvx",      "args": ["ai-first-scraper-mcp"]    }  }}

// claude_desktop_config.json  /  cline_mcp_settings.json  /  ~/.cursor/mcp.json{  "mcpServers": {    "ai-first-scraper": {      "command": "uvx",      "args": ["ai-first-scraper-mcp"]    }  }}

Restart your client (Claude Desktop / Cursor / Cline). The three tools above will appear automatically.

Alternative — pip install

Where the config file lives

Client	Config path
Claude Desktop (macOS)	`~/Library/Application Support/Claude/claude_desktop_config.json`
Claude Desktop (Windows)	`%APPDATA%\Claude\claude_desktop_config.json`
Cursor	`~/.cursor/mcp.json`
Cline (VS Code)	`~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json`

Point at your own backend (optional)

By default this server calls the public ai-first-scraper.onrender.com and ai-first-search.onrender.com instances. If you want to self-host, set env vars in your MCP config:

jsonc

{  "mcpServers": {    "ai-first-scraper": {      "command": "uvx",      "args": ["ai-first-scraper-mcp"],      "env": {        "SCRAPER_URL": "https://your-scraper.example.com",        "SEARCH_URL":  "https://your-search.example.com",        "AFS_TIMEOUT": "60"      }    }  }}

{  "mcpServers": {    "ai-first-scraper": {      "command": "uvx",      "args": ["ai-first-scraper-mcp"],      "env": {        "SCRAPER_URL": "https://your-scraper.example.com",        "SEARCH_URL":  "https://your-search.example.com",        "AFS_TIMEOUT": "60"      }    }  }}

Verify it works

Open your MCP client and ask the agent:

"Use the search_web tool to find the top 3 recent articles about MCP and summarize them in 5 bullets each."

You should see the agent call search_web, get back Markdown for each result, and produce the summary without ever touching raw HTML.

Companion projects

ai-first-scraper — the per-URL Markdown cleaner this MCP server fans out to.
ai-first-search — search → scrape → markdown pipeline.
mcp-rec — record & replay any MCP server's traffic for tests and bug reports.
llm-cache-proxy — local cache for OpenAI/Anthropic API calls.
promptlocker — lockfile for prompts.
context-diff — see what blew up your Claude Code context window.
agentwatch — overlay for browser AI agents.

Develop locally

bash

git clone https://github.com/yubinkim444/ai-first-scraper-mcp.gitcd ai-first-scraper-mcp
uv sync                    # or: pip install -e .ai-first-scraper-mcp       # speaks MCP over stdio

git clone https://github.com/yubinkim444/ai-first-scraper-mcp.gitcd ai-first-scraper-mcp
uv sync                    # or: pip install -e .ai-first-scraper-mcp       # speaks MCP over stdio

To test against a local client, point its MCP config at the same command.

About the author

Built by yubinkim444, who also makes Kay's Records — an app for iOS and Android.

If this project saved you time, giving the app a try is the nicest way to say thanks.

License

Source: README.md at commit ec64d75

Tools

SourceWeft has not started this package in its sandbox yet, so its tools are not known.

Version history

v1.0.2LatestSep 16, 2026

Score

50% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

Reached in the last 30 days25 pts
Keep the endpoint answering the MCP handshake; SourceWeft probes it every 30 days.
Auth declared10 pts
Declare the credential headers in the registry entry, or keep the endpoint answering the probe so its auth can be classified.
Tools listed15 pts
Answer tools/list without a credential, or ship a package that starts in a sandbox without one.
DescriptionRequired15 pts
Logo10 pts
Documentation15 pts
License10 pts

Other Ai-First integrations

AI-first company: evidence on AI adoption

company.ai-firstOfficial publisher

Gives an assistant a browsable map of rated evidence on AI adoption: practices, company cases, checked statistics, studies and readiness assessments.

Streamable HTTPWeb executable

Knowledge & Memory10 toolsOct 27, 2026