Anyfetch

Anyfetch

Web search and web fetch for AI agents. One small binary, no API keys, and it reads the sites that refuse your agent.

Free and open source, from the makers of AliasMode.

Agent harnesses fetch pages with a bot identity, and a large part of the web answers 403. Anyfetch sends the request a real browser sends, so your agent gets the page.

Anyfetch read 28 sites that no other tool in the table could read. Among them: The New York Times, Reuters, Bloomberg, The Washington Post, The Economist, Medium, Reddit, Stack Overflow, IMDb and YouTube.

Thirteen of the questions are about a page on a site that blocks AI agents. The built-in fetch could not read any of those 13 pages. Its search found the answer in another source for 7 of them. Anyfetch answered 12 in both runs. The questions were written from pages that Anyfetch can read, so this group shows what the built-in tools miss.

Sites: measured on 2026-10-12 with version 0.8.0. Questions: measured on 2026-10-12 with version 0.7.1. Time and memory: measured on 2026-10-11. All from a cloud server, with no proxy except in the proxy row. See how we measured and how to run it again.

What your agent gets

• Search with no key. Brave, Yahoo and DuckDuckGo results, with domain and date filters, quoted phrases and paging. Specialist sources for GitHub, Stack Overflow, Hacker News, arXiv and research papers. Or your own SearXNG.
• Search and read in one call. Ask for the top results together with the result list, and get the parts of each page that match your query.
• Answers, not whole pages. Give a question with the URL, and get only the parts of the page that match it. The Python 3.15 release notes are 218,000 characters; the answer to one question about them came back in 2,200.
• Clean Markdown. Links, tables and code blocks stay intact. Long pages come in parts.
• PDFs. Papers and reports come back as text, page by page.
• Sites that need JavaScript. Anyfetch reads the data inside the page, and uses the site's public API or feed for Stack Overflow, Reddit, IMDb, X posts, PyPI and crates.io. A Reddit thread comes with every comment and its score. No browser runs. For pages that hold nothing without their scripts, it can use Lightpanda, an optional small engine.
• News and answers. Full articles on Reuters and Bloomberg, the latest articles of The Economist, and the answers on Quora, from the data that these sites send.
• Home pages and listings. A page with no single article comes back as its headlines and links, in page order.
• Browser-grade requests. Safari's TLS, HTTP/2 and header fingerprint. A refused fetch is retried automatically, as the same browser or as a second one. Bot checks that are one fixed step, as on Reddit and Behance, are passed.
• Cloudflare checks. When a site insists on a JavaScript check, your own Firefox passes it once. After that, Anyfetch reads the site with plain requests.
• Fast on repeat. Several pages in one call, fetched at the same time. A page fetched in the last 15 minutes comes from a local copy.
• Lightweight. A 16 MB Rust binary. No bundled browser, no JavaScript engine, no Python, no Node.
• Works everywhere. A stdio MCP server for agent harnesses, and a plain CLI for everything else.

Install

macOS and Linux:

curl -fsSL https://aliasmode.github.io/anyfetch/install.sh | sh

Windows, in PowerShell:

irm https://aliasmode.github.io/anyfetch/install.ps1 | iex

The installer puts anyfetch in ~/.local/bin. Then it connects Anyfetch to each agent harness that it finds on the machine: Claude Code, Codex, Gemini CLI, Hermes Agent, Pi, Cline, Amp, OpenClaw and Cursor. Start a new agent session, and the agent has web_search, web_fetch and web_fetch_many.

Did you install a harness later? Run anyfetch setup. It uses each harness's own command, tells you what it connected, and is safe to run again.

Do you have Node.js? Then no install is needed. Give your MCP client this server, and npx gets the program for your platform:

{  "mcpServers": {    "anyfetch": { "command": "npx", "args": ["-y", "@aliasmode/anyfetch", "mcp"] }  }}

Only Claude Code, on macOS or Linux? You can install Anyfetch as a plugin instead. The plugin gets the program at its first start:

claude plugin marketplace add aliasmode/anyfetch && claude plugin install anyfetch@anyfetch

Inside Claude Code 2.1.275 or later, this is one step: /plugin install anyfetch --marketplace aliasmode/anyfetch. Use the plugin or the installer, not both, or the agent sees every tool twice.

Connect your agent by hand

anyfetch setup does this for you. To do it by hand, each harness needs one command.

Claude Code

claude mcp add --scope user anyfetch -- anyfetch mcp

Codex

codex mcp add anyfetch -- anyfetch mcp

or in ~/.codex/config.toml:

[mcp_servers.anyfetch]command = "anyfetch"args = ["mcp"]

Hermes Agent

hermes mcp add anyfetch --command anyfetch --args mcp

Hermes connects, lists the tools and asks to enable them. Answer Y.

Pi

pi mcp add anyfetch -- anyfetch mcp

Pi hides MCP tools behind its code mode by default. To show the tools to the model directly, set the exposure in ~/.pi/agent/mcp.json:

{  "mcpServers": {    "anyfetch": { "command": "anyfetch", "args": ["mcp"], "exposure": "direct" }  }}

Gemini CLI

gemini mcp add -s user anyfetch anyfetch mcp

OpenCode — in ~/.config/opencode/opencode.json:

{  "$schema": "https://opencode.ai/config.json",  "mcp": {    "anyfetch": { "type": "local", "command": ["anyfetch", "mcp"], "enabled": true }  }}

Cursor — in ~/.cursor/mcp.json:

{  "mcpServers": {    "anyfetch": { "command": "anyfetch", "args": ["mcp"] }  }}

More harnesses

Any other MCP client: add a stdio server with the command anyfetch and the argument mcp.

Anyfetch is in the official MCP Registry as io.github.aliasmode/anyfetch, and on npm as @aliasmode/anyfetch.

No MCP? Give the agent the CLI. Add this to AGENTS.md or the harness's instruction file:

## Web access- Search the web: `anyfetch search "<query>"`- Read pages: `anyfetch fetch <url> [<url>...] --format markdown`

Make it the default. Anyfetch tells the agent to use its tools in place of the built-in web tools. In our test with Claude Code, the agent then chose Anyfetch for 8 of 8 web tasks. Before, it chose Anyfetch for 2 of 8. To take the choice away, turn the built-ins off:

• Claude Code, in ~/.claude/settings.json: "permissions": { "deny": ["WebFetch", "WebSearch"] }
• Codex, in ~/.codex/config.toml: web_search = "disabled"

Use it from the command line

anyfetch search "rust async runtime comparison"anyfetch search "tokio select" --site docs.rs --time yearanyfetch search "postgres vacuum freeze" --read 3anyfetch search "retrieval augmented generation" --provider papersanyfetch fetch https://stackoverflow.com/questions/231767 --format markdownanyfetch fetch https://arxiv.org/pdf/1706.03762 --max-chars 8000 --offset 8000anyfetch fetch https://docs.python.org/3.15/whatsnew/3.15.html --query "sampling profiler rate"anyfetch fetch https://www.rust-lang.org/ https://go.dev/ https://ziglang.org/

Output is JSON by default, so scripts and agents can parse it. --format markdown prints only the page content.

Tools

web_fetch

The result has title, description, content (Markdown), total_chars, url (after redirects), status and retrieved_at. To read a long page in parts, call again with a higher offset until it reaches total_chars. The parts come from the local copy, so the site gets one request.

With a query, the page is split at its paragraphs, tables and code blocks. The parts that best match the words of the query come back in page order, under their headings, with [...] where parts are left out. The result then has focused: true. A page with no matching part comes back from its start. A second question about the same page uses the local copy.

HTML becomes Markdown. A PDF becomes text with [Page N] marks. JSON, plain text and XML feeds come back as they are.

web_fetch_many

The result has pages: one entry per URL, in order. Each entry is the page, or its error.

web_search

Each result has title, url and snippet, and content when you set read.

site, time and quoted phrases apply to the web engines. The specialist sources are free public APIs with their own request limits.

Errors

A failed call returns an error object with a code the agent can act on:

Cloudflare checks

Some sites answer every first request with a JavaScript check. Anyfetch handles it in two steps:

1. Your own Firefox passes the check once. It runs hidden, with a throwaway profile, for a few seconds.
2. Anyfetch saves the clearance for that site and goes back to plain requests. On Medium, one pass is good for a year.

In our test, the first page of such a site took about 5 seconds and the next one under 2 seconds.

This needs Firefox, or a Firefox-based browser, on the machine. Without one, nothing changes: the fetch returns challenge_required.

For an MCP server, set the variable in the server entry. In Claude Code:

claude mcp add --scope user anyfetch -e ANYFETCH_BROWSER=off -- anyfetch mcp

Notes:

• Tested on Linux. On Windows, and for a snap-packaged Firefox (the Ubuntu default), the browser is used only when ANYFETCH_BROWSER names it.
• A clearance belongs to the address that earned it, so the browser is not used together with a proxy.
• Saved clearances are in ~/.config/anyfetch/clearance/. Delete a file to forget a site.

Pages that need their scripts

Most pages give Anyfetch their text without JavaScript: it is in the HTML, in the page's data, or behind a public API. A few hold nothing until their scripts run. MSN, Spotify and Airbnb are examples. For those, Anyfetch can use Lightpanda, a small headless engine without a full browser.

Lightpanda is optional and separate. Install it from its README, put lightpanda on your PATH, and Anyfetch uses it for the pages that need it. In our test, MSN went from no content to 154,000 characters in 12 seconds, and Spotify from no content to 23,000 characters in 3 seconds. Pages that already work are not rendered, so they stay fast.

Notes:

• Lightpanda makes its own requests. It is not used together with a proxy, and a site with a bot check can refuse it.
• A rendered application page, such as a feed or a listing, comes back as the whole page in Markdown.

Use a proxy

Some sites refuse cloud server addresses whatever the request looks like. If your agent runs on a server, send Anyfetch through a residential proxy. Put one line in ~/.config/anyfetch/proxy:

host:port:username:password

Anyfetch then sends every search and fetch through that HTTP proxy. The file holds the password in plain text, so keep it private: chmod 600 ~/.config/anyfetch/proxy. Delete the file to go direct again.

Some sites accept your own address and refuse the proxy's address. To reach both kinds, add a second line with the word direct. Anyfetch then tries the proxy first, and asks the site directly when the proxy route is refused.

Need a proxy? Use NobleProxy, our own service. In our test, one NobleProxy address took Anyfetch from 82 to 87 of the 97 sites, with the same result in every run. It opened The Wall Street Journal, Tripadvisor, Yelp, Etsy and Bandcamp, which refuse a server address. You get a static residential IP that only you use, with unlimited bandwidth and HTTP support.

What it does not do

Anyfetch itself does not run JavaScript, solve CAPTCHAs or log in. A page that shows its content only after its scripts run, with no data inside the HTML and no public API, returns its title and description unless Lightpanda is installed. It reads what a site sends to a first-time visitor. A page that needs a CAPTCHA, an account or a subscription to load stays closed, and Anyfetch says so with an error code.

Does your agent need a real browser, with logins and saved sessions? Use AliasMode. It is our free, open-source antidetect browser, and it has its own MCP server for agents.

Benchmark

The numbers at the top come from two scripts and one question set in bench/.

• Pages read. bench/bench.py reads each of the 97 sites in bench/sites.txt once with each tool. A page counts as read when the tool returns at least 500 characters of text and the text is not a bot check. The same rule is applied to every tool. Anyfetch ran three times and read 82, 81 and 82 pages; the table shows the middle run. Through a NobleProxy static residential IP, a fixed address of a US cable provider, with the direct line in the proxy file, it read 87 pages in each of three runs. The proxy added The Wall Street Journal, Tripadvisor, Yelp, Etsy and Bandcamp. The other tools were not tested through the proxy. Claude Code's WebFetch cannot be scripted, so an agent called it once per site and recorded if real content came back.

• Time and memory. bench/speed.py reads 10 pages with each program, started fresh for every page, and reports the median.

• Research questions. bench/tasks.json has 33 questions. Each has one exact answer and the sentence on the source page that proves it. The pages are from July to October 2026, so a model cannot answer from memory. A Claude Sonnet agent answered the questions with Anyfetch only, and again with the built-in WebSearch and WebFetch of Claude Code only. The instructions were the same: at most 8 web calls for each question, and the answer UNKNOWN when the tools do not give it. Anyfetch ran with no proxy, no Firefox and no Lightpanda. Each tool ran twice, and a question counts when both runs are correct.

In single runs, Anyfetch answered 32 and 33 questions, and the built-in tools 28 and 27. The one Anyfetch miss was a Reddit thread: Reddit limited the rate of the test machine that day, and in one run Anyfetch read a link from a comment in place of the link of the post.

Three things to know about this test. The question writer used Anyfetch to check each answer, so the first group has only pages that Anyfetch can read. The Financial Times was on the writer's list and has no question: its articles need a subscription. Thirty of the questions are one day older than the test; 28 of their answers were checked on the source page again that day. Every answer is in bench/results/tasks.tsv.

We also read the same 97 sites with eight other tools, each with its default settings and no API key:

How each one ran, and what to know before you compare, is in bench/other-tools/NOTES.md. The full ranking with every site is on aliasmode.com.

The per-site results are in bench/results/. Sites change their rules often, and results differ between networks, so run it yourself:

python3 bench/bench.py anyfetch curlpip install mcp-server-fetch && python3 bench/bench.py referencepython3 bench/speed.py /path/to/chromium

Build from source

You need Rust 1.98, cmake and clang (the TLS library is BoringSSL). On Windows you also need NASM.

cargo install --git https://github.com/aliasmode/anyfetch

License

Apache-2.0