searchio

io.github.IOServicesLabs由 GitHub 账号 IOServicesLabs 发布v0.1.1更新于 Nov 1, 2026

Keyless web search and page reading for AI agents, built to get past bot walls.

概览

AI 生成的概览

为 AI 助手提供免密钥网页搜索、网页正文读取、商品比价与 YouTube 字幕,并能绕过机器人拦截。

可以做什么
  • 按意图、域名与时效条件在多个免密钥来源中搜索网页
  • 把网址读成 markdown 文本,可越过机器人校验与纯 JavaScript 页面
  • 查询跨零售商的商品列表与价格,以及某城市附近的 Facebook Marketplace 分类信息
  • 获取单个 YouTube 视频的字幕文本
  • 运行多步研究流程回答问题,并查看抓取层级与来源健康状况
适用场景
适合需要实时网页结果、可读正文、商品价格对比或视频字幕,又不想申请搜索 API 的场景。研究工具用于需要多步深挖的问题,前提是能接受付费模型密钥。
运行要求
以 stdio 在本地运行。需要 Docker,或 Python 3.10 以上并安装 searchio 的 MCP 附加组件;npm 启动器会自动选择 Docker 或本地安装。可选的 Rust 引擎 sidecar 由 shell 脚本安装。研究工具需要 ANTHROPIC_API_KEY 或 DEEPSEEK_API_KEY,并配合 SEARCHIO_LLM_PROVIDER。配置项均为 SEARCHIO_ 前缀的环境变量。
安装前请注意
研究工具会产生费用,并把问题发送给付费大模型服务商。MCP 付费闸门(SEARCHIO_MCP_PAYMENT、SEARCHIO_MCP_BEARER)只是占位形式且没有账本,对外托管前需接入真正的验证器。浏览器抓取与放行 cookie 会存放在状态目录中;robots 策略默认是 warn 而非强制。

安装

在 SourceWeft 中

  1. 打开 控制台中的 searchio,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Desktop only,通过 STDIO。 STDIO 服务会启动本地进程,因此需要 SourceWeft 桌面宿主。

其他 MCP 客户端

参照 仓库 中的启动说明。

README

searchio

searchio is a tool for search, page reading, and product lookup. Use it from the command line, from Python, or over HTTP. Use it as a person or as an AI agent. Search and reading need no API key.

Quick start for AI agents

An AI agent can set up searchio for its user in one pass. Follow these steps in order. Stop when the verify step passes.

1. Use Docker when Docker runs. Try:

bash
docker run -i --rm ghcr.io/ioserviceslabs/searchio-mcp

The image holds the full system: fetch ladder, Rust engine sidecar, and a Chromium for the challenge tier. No other install step. Go to step 3.

2. No Docker: install from source. Needs Python 3.10 or newer.

bash
pip install "searchio[mcp]"curl -fsSL https://raw.githubusercontent.com/IOServicesLabs/searchio-engine/main/scripts/install.sh | sh

The pip command installs the searchio package with the MCP server from PyPI. The curl command adds the Rust engine sidecar at ~/.searchio/bin/se-serve (linux, macOS, Windows with Git Bash). The sidecar is the fast tier-2 backend. It is optional but recommended. For the latest development build use pip install "searchio[mcp] @ git+https://github.com/IOServicesLabs/searchio".

3. Add the MCP server to the client. Claude Desktop and Cursor use this config shape.

Docker:

json
{  "mcpServers": {    "searchio": {      "command": "docker",      "args": ["run", "-i", "--rm", "ghcr.io/ioserviceslabs/searchio-mcp"]    }  }}

Source install:

json
{  "mcpServers": {    "searchio": { "command": "searchio-mcp" }  }}

4. Verify. Restart the client. Ask: "Use searchio to search the web for the current time in Tokyo." Real results mean the setup works. An error about a missing command means the config points at a path that does not exist; fix the config and retry.

Note. npx @ioserviceslabs/searchio-mcp also works as the client command in step 3. The launcher starts the Docker image when Docker runs. Without Docker it starts the local install from step 2.

1. Install

You need Python 3.10 or newer.

Path A -- pip (one command):

bash
pip install "searchio[mcp]"searchio-mcp        # MCP server on stdio, ready for an LLM client

searchio doctor checks the install. The Rust engine sidecar is optional. Install it with the curl command in the quick start, step 2.


Path B -- Docker (no Python needed):

bash
docker run -i --rm ghcr.io/ioserviceslabs/searchio-mcp              # stdio MCPdocker run -p 8080:8080 ghcr.io/ioserviceslabs/searchio-mcp \  searchio-mcp --transport sse --host 0.0.0.0 --port 8080

No prebuilt image for your platform? Build from source:

bash
docker build -t searchio https://github.com/IOServicesLabs/searchio.git

The image holds the full ladder: the Python tiers, the Rust engine sidecar, and a Chromium for the challenge tier. State (clearance, sessions) persists in a volume at /root/.searchio:

bash
docker run -i --rm -v searchio-state:/root/.searchio ghcr.io/ioserviceslabs/searchio-mcp

Path C -- from source:

bash
git clone https://github.com/IOServicesLabs/searchio.gitcd searchiopython -m venv .venv.venv\Scripts\activate          # Windows# source .venv/bin/activate     # macOS / Linuxpip install -e '.[mcp]'searchio doctor

searchio doctor shows which fetch tiers work on your machine. Tier 0 is plain HTTP. Tier 1 adds TLS impersonation. Tier 2 adds a real browser for pages that block bots. Tier 2 starts on its own the first time it is needed.

The engine tier (optional, recommended)

Tier 2 uses the Rust searchio-engine sidecar when a se-serve binary is present. It boots in milliseconds and has no Chromium. The Docker image includes it. On a host install, one command adds it:

bash
curl -fsSL https://raw.githubusercontent.com/IOServicesLabs/searchio-engine/main/scripts/install.sh | sh

The installer drops the binary at ~/.searchio/bin/se-serve and searchio finds it on its own. You can also set SEARCHIO_ENGINE_BIN to any binary.

MCP client setup

Point any MCP client at the server:

json
{  "mcpServers": {    "searchio": {      "command": "searchio-mcp"    }  }}

With Docker, use "command": "docker", "args": ["run", "-i", "--rm", "searchio"].

No Python at all? The npm wrapper picks a backend for you (Docker when present, else a local install):

json
{  "mcpServers": {    "searchio": {      "command": "npx",      "args": ["-y", "@ioserviceslabs/searchio-mcp"]    }  }}

2. Search

bash
searchio search "best noise cancelling headphones 2026"searchio search "rust async runtime comparison" --intent codesearchio search "artemis mission" --domains nasa.govsearchio search "heat pump retrofit" --k 20 --json

You can set an intent: web (default), news, video, shopping, academic, code, forum, reference, local. You can also put site:nasa.gov in the query.

3. Read a page

bash
searchio read https://example.com/some/articlesearchio read https://example.com/paper.pdf --chars 20000

The command prints the readable text. It climbs walls, bot checks, and JavaScript-only pages on its own. If a page cannot be read, you get a clear reason. You do not get an empty page.

4. Products and listings

bash
searchio items "sony wh-1000xm5"                    # one row per product across retailerssearchio items "dyson v15" --domains bestbuy.com --jsonsearchio marketplace "ford f-150" --city seattle    # Facebook Marketplace, browser-backed

5. Research with an AI swarm

This part costs money. Set one key:

bash
set ANTHROPIC_API_KEY=...            # Windows# export ANTHROPIC_API_KEY=...       # macOS / Linuxsearchio research "What changed in the EU battery regulation this year, and who is affected?"

To use DeepSeek instead, set SEARCHIO_LLM_PROVIDER=deepseek and DEEPSEEK_API_KEY=.... The answer comes back with findings. Each finding cites pages the workers read.

6. Run it as an MCP server

searchio is also an MCP (Model Context Protocol) server. AI agents call it over MCP. The same tools that the CLI uses are available to the agent.

Install the MCP extra:

bash
pip install -e '.[mcp]'

Start the server over stdio:

bash
searchio mcp# orpython -m searchio.mcp

Start the server over HTTP:

bash
searchio mcp --transport streamable-http --host 127.0.0.1 --port 8080 --path /mcp

6.1 MCP tools

The server has these tools:

ToolWhat it does
searchFused, ranked web search across keyless providers.
search_itemsProduct listings with prices, merged across retailers.
search_localFacebook Marketplace classifieds near a city (browser-backed).
youtube_transcriptCaption transcript of one YouTube video: timed segments + full text.
read_urlRead one URL through the blocking-resistant ladder. Returns markdown.
researchRun the multi-step research swarm on a question (needs an LLM key).
statsLadder and provider health (per-domain learned tiers, block rates).

The server also has one resource: searchio://health returns service health as a small JSON object.

6.2 Payment for search and research (x402)

The MCP server has a payment gate. It uses the x402 shape. When the gate is on, a billable tool returns a 402 (Payment Required) with an X-Payment challenge until the caller pays.

Set the gate with SEARCHIO_MCP_PAYMENT:

ValueResult
`` (empty, default)Gate open. Nothing is charged. For local and dev use.
static:<token>The caller must send Authorization: Bearer <token>. Without it the tool returns a 402 + X-Payment challenge.

This is the shape a real verifier uses. It has no ledger. When you host the server for others, put a real x402 verifier in front. The verifier checks payment, then the tool runs. This is how searchio is hosted next to SwarmIO for search and research credits.

7. Run it as an HTTP server

bash
searchio serve --port 8080
EndpointWhat it does
GET /search?q=...&intent=web&k=10&domains=a.com,b.org&freshness=week&locale=de-DESearch results
GET /read?url=...&session=meReadable text of one page
GET /items?q=...&domains=...Product listings merged per product
GET /marketplace?q=...&city=seattleFacebook Marketplace listings
GET /transcript?url=...&lang=enYouTube caption transcript (400 not-a-video · 404 no captions · 451 refused)
POST /research {"question": "..."}The AI research swarm
GET /providers, GET /stats, GET /healthzStatus

Errors are honest status codes: 422 for a bad request, 400 for a target the policy refuses, 451 for a page blocked by an anti-bot wall, 502 or 503 when providers failed or are all cooling down after failures. A search answer lists providers_used, providers_failed and providers_skipped (breakers open, with the cooldown left).

If several people or agents share one server, give each its own session on /read. Then cookies from one never ride along on another's requests.

8. Run it in Docker

The Dockerfile in this repo builds the full ladder: Python tiers, the Rust engine sidecar, and a Chromium for the challenge tier. See Path B in section 1 for the build and run commands. docker compose up does the same with the state volume wired up.

Inside the container, tier 2 is the engine sidecar first; the patchright Chromium takes the pages that need a real browser (the challenge tier). Cache, learned per-domain tiers, and clearance cookies live in the searchio-state volume, so they survive restarts. Keys for the research swarm go in as environment variables, the same names as in section 10.

9. Use it from Python

python
import asynciofrom searchio.engine import Engine
async def main():    eng = Engine()    res = await eng.search("lithium iron phosphate battery lifespan", intent="web", k=5)    for doc in res.docs:        print(doc.title, doc.url)
    doc = await eng.read("https://example.com/article")    print(doc.text[:500])
    items = await eng.find_items("sony wh-1000xm5")    for it in items:        print(it.title, it.price, it.url)
    await eng.close()
asyncio.run(main())

10. Settings

Everything is an environment variable with the SEARCHIO_ prefix, or a line in a .env file next to where you run it. The ones people change most:

VariableDefaultMeaning
SEARCHIO_MAX_TIER20 HTTP only, 1 adds TLS impersonation, 2 adds the browser
SEARCHIO_ROBOTS_POLICYwarnenforce, warn, or off
SEARCHIO_PROXYnoneProxy URL for the HTTP tiers
SEARCHIO_FACEBOOK_CITYnoneDefault city for Marketplace searches
SEARCHIO_CACHE_ENABLEDtrueCache fetched pages for an hour
SEARCHIO_STATE_DIR~/.searchioWhere cache, profiles and clearance cookies live
SEARCHIO_MCP_PAYMENT``MCP payment gate (see 6.2)
SEARCHIO_MCP_BEARERnoneBearer token the MCP gate checks

11. Good to know

  • Search and reading need no keys and cost nothing. Only research calls a paid model.
  • The tool never sends your credentials anywhere. Marketplace and other browser-backed lookups run anonymously.
  • searchio providers lists every source and whether it is configured.
  • searchio doctor is the first thing to run when something looks off.

来源:README.md,提交 e2fad78

工具

0
SourceWeft 尚未在沙箱中启动过该软件包,因此其工具未知。

版本历史

1
  1. v0.1.1最新Oct 11, 2026

评分

已满足适用检查项的 50%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通25 分

    请保持端点能够响应 MCP 握手;SourceWeft 每 30 天探测一次。

  • 已声明认证方式10 分

    请在注册中心条目中声明凭据请求头,或保持端点能够响应探测,以便判定其认证方式。

  • 已列出工具15 分

    请让服务器在无凭据时响应 tools/list,或发布可在沙箱中无凭据启动的软件包。

  • 描述必需15 分
  • 图标10 分
  • 文档15 分
  • 许可证10 分