searchio

io.github.IOServicesLabs由 GitHub 帳號 IOServicesLabs 發布v0.1.1更新於 Nov 1, 2026

Keyless web search and page reading for AI agents, built to get past bot walls.

概覽

AI 產生的概覽

為 AI 助理提供免金鑰網頁搜尋、網頁正文擷取、商品比價與 YouTube 字幕,並能繞過機器人阻擋。

可以做什麼
  • 依意圖、網域與時效條件在多個免金鑰來源搜尋網頁
  • 把網址讀成 markdown 文字,可越過機器人檢查與純 JavaScript 頁面
  • 查詢跨零售商的商品清單與價格,以及某城市附近的 Facebook Marketplace 分類廣告
  • 取得單一 YouTube 影片的字幕文字
  • 執行多步研究流程回答問題,並查看抓取層級與來源健康狀態
適用情境
適合需要即時網頁結果、可讀正文、商品價格比較或影片字幕,又不想申請搜尋 API 的情況。研究工具用於需要多步深入的問題,前提是能接受付費模型金鑰。
執行需求
以 stdio 在本機執行。需要 Docker,或 Python 3.10 以上並安裝 searchio 的 MCP 附加元件;npm 啟動器會自動選擇 Docker 或本機安裝。可選的 Rust 引擎 sidecar 由 shell 腳本安裝。研究工具需要 ANTHROPIC_API_KEY 或 DEEPSEEK_API_KEY,並搭配 SEARCHIO_LLM_PROVIDER。設定項皆為 SEARCHIO_ 前綴的環境變數。
安裝前請注意
研究工具會產生費用,並把問題傳送給付費大型語言模型服務商。MCP 付費閘門(SEARCHIO_MCP_PAYMENT、SEARCHIO_MCP_BEARER)只是佔位形式且沒有帳本,對外託管前需接上真正的驗證器。瀏覽器抓取與通行 cookie 會存放在狀態目錄中;robots 政策預設為 warn 而非強制執行。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 searchio,將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。

其他 MCP 客戶端

參照 儲存庫 中的啟動說明。

README

searchio

searchio is a tool for search, page reading, and product lookup. Use it from the command line, from Python, or over HTTP. Use it as a person or as an AI agent. Search and reading need no API key.

Quick start for AI agents

An AI agent can set up searchio for its user in one pass. Follow these steps in order. Stop when the verify step passes.

1. Use Docker when Docker runs. Try:

bash
docker run -i --rm ghcr.io/ioserviceslabs/searchio-mcp

The image holds the full system: fetch ladder, Rust engine sidecar, and a Chromium for the challenge tier. No other install step. Go to step 3.

2. No Docker: install from source. Needs Python 3.10 or newer.

bash
pip install "searchio[mcp]"curl -fsSL https://raw.githubusercontent.com/IOServicesLabs/searchio-engine/main/scripts/install.sh | sh

The pip command installs the searchio package with the MCP server from PyPI. The curl command adds the Rust engine sidecar at ~/.searchio/bin/se-serve (linux, macOS, Windows with Git Bash). The sidecar is the fast tier-2 backend. It is optional but recommended. For the latest development build use pip install "searchio[mcp] @ git+https://github.com/IOServicesLabs/searchio".

3. Add the MCP server to the client. Claude Desktop and Cursor use this config shape.

Docker:

json
{  "mcpServers": {    "searchio": {      "command": "docker",      "args": ["run", "-i", "--rm", "ghcr.io/ioserviceslabs/searchio-mcp"]    }  }}

Source install:

json
{  "mcpServers": {    "searchio": { "command": "searchio-mcp" }  }}

4. Verify. Restart the client. Ask: "Use searchio to search the web for the current time in Tokyo." Real results mean the setup works. An error about a missing command means the config points at a path that does not exist; fix the config and retry.

Note. npx @ioserviceslabs/searchio-mcp also works as the client command in step 3. The launcher starts the Docker image when Docker runs. Without Docker it starts the local install from step 2.

1. Install

You need Python 3.10 or newer.

Path A -- pip (one command):

bash
pip install "searchio[mcp]"searchio-mcp        # MCP server on stdio, ready for an LLM client

searchio doctor checks the install. The Rust engine sidecar is optional. Install it with the curl command in the quick start, step 2.


Path B -- Docker (no Python needed):

bash
docker run -i --rm ghcr.io/ioserviceslabs/searchio-mcp              # stdio MCPdocker run -p 8080:8080 ghcr.io/ioserviceslabs/searchio-mcp \  searchio-mcp --transport sse --host 0.0.0.0 --port 8080

No prebuilt image for your platform? Build from source:

bash
docker build -t searchio https://github.com/IOServicesLabs/searchio.git

The image holds the full ladder: the Python tiers, the Rust engine sidecar, and a Chromium for the challenge tier. State (clearance, sessions) persists in a volume at /root/.searchio:

bash
docker run -i --rm -v searchio-state:/root/.searchio ghcr.io/ioserviceslabs/searchio-mcp

Path C -- from source:

bash
git clone https://github.com/IOServicesLabs/searchio.gitcd searchiopython -m venv .venv.venv\Scripts\activate          # Windows# source .venv/bin/activate     # macOS / Linuxpip install -e '.[mcp]'searchio doctor

searchio doctor shows which fetch tiers work on your machine. Tier 0 is plain HTTP. Tier 1 adds TLS impersonation. Tier 2 adds a real browser for pages that block bots. Tier 2 starts on its own the first time it is needed.

The engine tier (optional, recommended)

Tier 2 uses the Rust searchio-engine sidecar when a se-serve binary is present. It boots in milliseconds and has no Chromium. The Docker image includes it. On a host install, one command adds it:

bash
curl -fsSL https://raw.githubusercontent.com/IOServicesLabs/searchio-engine/main/scripts/install.sh | sh

The installer drops the binary at ~/.searchio/bin/se-serve and searchio finds it on its own. You can also set SEARCHIO_ENGINE_BIN to any binary.

MCP client setup

Point any MCP client at the server:

json
{  "mcpServers": {    "searchio": {      "command": "searchio-mcp"    }  }}

With Docker, use "command": "docker", "args": ["run", "-i", "--rm", "searchio"].

No Python at all? The npm wrapper picks a backend for you (Docker when present, else a local install):

json
{  "mcpServers": {    "searchio": {      "command": "npx",      "args": ["-y", "@ioserviceslabs/searchio-mcp"]    }  }}

2. Search

bash
searchio search "best noise cancelling headphones 2026"searchio search "rust async runtime comparison" --intent codesearchio search "artemis mission" --domains nasa.govsearchio search "heat pump retrofit" --k 20 --json

You can set an intent: web (default), news, video, shopping, academic, code, forum, reference, local. You can also put site:nasa.gov in the query.

3. Read a page

bash
searchio read https://example.com/some/articlesearchio read https://example.com/paper.pdf --chars 20000

The command prints the readable text. It climbs walls, bot checks, and JavaScript-only pages on its own. If a page cannot be read, you get a clear reason. You do not get an empty page.

4. Products and listings

bash
searchio items "sony wh-1000xm5"                    # one row per product across retailerssearchio items "dyson v15" --domains bestbuy.com --jsonsearchio marketplace "ford f-150" --city seattle    # Facebook Marketplace, browser-backed

5. Research with an AI swarm

This part costs money. Set one key:

bash
set ANTHROPIC_API_KEY=...            # Windows# export ANTHROPIC_API_KEY=...       # macOS / Linuxsearchio research "What changed in the EU battery regulation this year, and who is affected?"

To use DeepSeek instead, set SEARCHIO_LLM_PROVIDER=deepseek and DEEPSEEK_API_KEY=.... The answer comes back with findings. Each finding cites pages the workers read.

6. Run it as an MCP server

searchio is also an MCP (Model Context Protocol) server. AI agents call it over MCP. The same tools that the CLI uses are available to the agent.

Install the MCP extra:

bash
pip install -e '.[mcp]'

Start the server over stdio:

bash
searchio mcp# orpython -m searchio.mcp

Start the server over HTTP:

bash
searchio mcp --transport streamable-http --host 127.0.0.1 --port 8080 --path /mcp

6.1 MCP tools

The server has these tools:

ToolWhat it does
searchFused, ranked web search across keyless providers.
search_itemsProduct listings with prices, merged across retailers.
search_localFacebook Marketplace classifieds near a city (browser-backed).
youtube_transcriptCaption transcript of one YouTube video: timed segments + full text.
read_urlRead one URL through the blocking-resistant ladder. Returns markdown.
researchRun the multi-step research swarm on a question (needs an LLM key).
statsLadder and provider health (per-domain learned tiers, block rates).

The server also has one resource: searchio://health returns service health as a small JSON object.

6.2 Payment for search and research (x402)

The MCP server has a payment gate. It uses the x402 shape. When the gate is on, a billable tool returns a 402 (Payment Required) with an X-Payment challenge until the caller pays.

Set the gate with SEARCHIO_MCP_PAYMENT:

ValueResult
`` (empty, default)Gate open. Nothing is charged. For local and dev use.
static:<token>The caller must send Authorization: Bearer <token>. Without it the tool returns a 402 + X-Payment challenge.

This is the shape a real verifier uses. It has no ledger. When you host the server for others, put a real x402 verifier in front. The verifier checks payment, then the tool runs. This is how searchio is hosted next to SwarmIO for search and research credits.

7. Run it as an HTTP server

bash
searchio serve --port 8080
EndpointWhat it does
GET /search?q=...&intent=web&k=10&domains=a.com,b.org&freshness=week&locale=de-DESearch results
GET /read?url=...&session=meReadable text of one page
GET /items?q=...&domains=...Product listings merged per product
GET /marketplace?q=...&city=seattleFacebook Marketplace listings
GET /transcript?url=...&lang=enYouTube caption transcript (400 not-a-video · 404 no captions · 451 refused)
POST /research {"question": "..."}The AI research swarm
GET /providers, GET /stats, GET /healthzStatus

Errors are honest status codes: 422 for a bad request, 400 for a target the policy refuses, 451 for a page blocked by an anti-bot wall, 502 or 503 when providers failed or are all cooling down after failures. A search answer lists providers_used, providers_failed and providers_skipped (breakers open, with the cooldown left).

If several people or agents share one server, give each its own session on /read. Then cookies from one never ride along on another's requests.

8. Run it in Docker

The Dockerfile in this repo builds the full ladder: Python tiers, the Rust engine sidecar, and a Chromium for the challenge tier. See Path B in section 1 for the build and run commands. docker compose up does the same with the state volume wired up.

Inside the container, tier 2 is the engine sidecar first; the patchright Chromium takes the pages that need a real browser (the challenge tier). Cache, learned per-domain tiers, and clearance cookies live in the searchio-state volume, so they survive restarts. Keys for the research swarm go in as environment variables, the same names as in section 10.

9. Use it from Python

python
import asynciofrom searchio.engine import Engine
async def main():    eng = Engine()    res = await eng.search("lithium iron phosphate battery lifespan", intent="web", k=5)    for doc in res.docs:        print(doc.title, doc.url)
    doc = await eng.read("https://example.com/article")    print(doc.text[:500])
    items = await eng.find_items("sony wh-1000xm5")    for it in items:        print(it.title, it.price, it.url)
    await eng.close()
asyncio.run(main())

10. Settings

Everything is an environment variable with the SEARCHIO_ prefix, or a line in a .env file next to where you run it. The ones people change most:

VariableDefaultMeaning
SEARCHIO_MAX_TIER20 HTTP only, 1 adds TLS impersonation, 2 adds the browser
SEARCHIO_ROBOTS_POLICYwarnenforce, warn, or off
SEARCHIO_PROXYnoneProxy URL for the HTTP tiers
SEARCHIO_FACEBOOK_CITYnoneDefault city for Marketplace searches
SEARCHIO_CACHE_ENABLEDtrueCache fetched pages for an hour
SEARCHIO_STATE_DIR~/.searchioWhere cache, profiles and clearance cookies live
SEARCHIO_MCP_PAYMENT``MCP payment gate (see 6.2)
SEARCHIO_MCP_BEARERnoneBearer token the MCP gate checks

11. Good to know

  • Search and reading need no keys and cost nothing. Only research calls a paid model.
  • The tool never sends your credentials anywhere. Marketplace and other browser-backed lookups run anonymously.
  • searchio providers lists every source and whether it is configured.
  • searchio doctor is the first thing to run when something looks off.

來源:README.md,提交 e2fad78

工具

0
SourceWeft 尚未在沙箱中啟動過該軟體包,因此其工具未知。

版本歷史

1
  1. v0.1.1最新Oct 11, 2026

評分

已滿足適用檢查項的 50%

該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通25 分

    請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。

  • 已宣告認證方式10 分

    請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。

  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分