DeepSift Search

io.github.pavanmulka由 GitHub 帳號 pavanmulka 發布v0.1.0更新於 Nov 5, 2026

Live Google web search for AI agents that returns only the passages that answer the question.

已驗證Streamable HTTP可網頁執行網頁搜尋與抓取知識與記憶

概覽

AI 產生的概覽

託管式網頁搜尋 MCP 伺服器，執行 Google 搜尋並只回傳能回答問題的網頁段落，另提供讀取、網站地圖、爬取與深度研究工具。

可以做什麼
  • 針對一個主題搜尋網頁，在一次回覆中給出多個網站裡最相關的段落
  • 讀取最多 20 個網頁或 PDF 的全文，或只取與指定主題相關的部分
  • 列出某個網站的頁面位址，並爬取同一網站的多个頁面、保留相關內容
  • 執行多輪搜尋的調查任務，回傳附編號來源的書面報告
  • 提供與 Tavily 相同的 search、extract、crawl、map 請求與回應格式
適用情境
適合需要附來源的即時網頁答案、而不只是連結清單的情境，也適合想用託管端點而非自行在本機架設搜尋流程的人。可用於調查、價格或文件查詢以及整站閱讀。
執行需求
遠端 streamable HTTP 端點，無需本機安裝。需要 Apify API 權杖，以 Bearer 形式放在 Authorization 標頭中。免費 Apify 帳號每月含一定額度，用量依搜尋次數與讀取頁數計費。
安裝前請注意
依用量付費：每 1,000 次搜尋 4 美元、每 1,000 個頁面 1 美元，從 Apify 額度扣除。Apify 權杖屬機密，可存取你的帳號。查詢內容與抓取的頁面內容會傳送到託管服務及 Google。調查任務可能耗時數分鐘。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 DeepSift Search，將其新增到工作區。
  2. 連接 Authorization token 憑證。它們會被私密儲存，絕不會在公開頁面上展示。
  3. 為需要使用其工具的對話啟用該服務。

Web executable，透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

交給代理程式安裝

把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式，或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南，先向你展示發布者、端點和登入方式，經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。

閱讀 https://sourceweft.com/mcp/io.github.pavanmulka%2Fdeepsift-search/install.md，並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前，先告訴我它的發布者、端點和登入方式，等我確認。不要把 API 金鑰寫進命令或我會提交的檔案；問我金鑰應從哪裡取得。

檢視代理程式所依據的安裝指南

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。

{
  "mcpServers": {
    "deepsift-search": {
      "type": "http",
      "url": "https://aadstra--deepsift-search.apify.actor/mcp",
      "headers": {
        "Authorization": "Bearer <YOUR_TOKEN>"
      }
    }
  }
}

README

DeepSift

A free, self-hosted alternative to Tavily for Claude Code. Ask one question; DeepSift searches the web, reads every page, and hands back only the paragraphs that matter. It runs on your laptop and uses the Claude subscription you already pay for.

Tavily is a paid web search API built for AI agents. You send one question; it searches the web, opens the best pages, cuts out the passages that answer the question, and sends it all back in one tidy reply. That's great, but every call costs credits.

DeepSift does the same job on your own computer, in three steps:

  1. Find the right websites, using Claude's web search on your existing Claude subscription (with free DuckDuckGo as a backup).
  2. Read every page itself: HTML and PDFs, with menus, ads and clutter stripped out.
  3. Pick the passages that best match your question, and give them back in one reply.

No per-call bill, no API key to buy.

Don't want to run it yourself? Use DeepSift Search on Apify

[DeepSift Search icon]

DeepSift Search is the hosted version: real Google results, the same passage picking, nothing to install, and it works for apps and teams, not just your own laptop.

  • Tavily drop-in: same /search, /extract, /crawl and /map requests and responses. Change one line:

    python
    from tavily import TavilyClientclient = TavilyClient(api_key="<YOUR_APIFY_TOKEN>", api_base_url="https://aadstra--deepsift-search.apify.actor")

  • MCP server for Claude, Cursor and others: https://aadstra--deepsift-search.apify.actor/mcp with your Apify token as a Bearer header.

  • Claude Code plugin: /plugin marketplace add pavanmulka/deepsift, then /plugin install deepsift-search@deepsift. Claude Code asks for your Apify token once.

  • Pay per use, no subscription: $4 per 1,000 searches, $1 per 1,000 pages read. Failed requests are free, and a free Apify account includes $5 of credit every month.

The Apify version lives in .actor/ and deepsift/actor.py; it never uses your Claude subscription.

What Claude Code gets

After installing, every Claude Code session has these tools:

ToolWhat you'd askWhat it does
web_search"web_search Databricks Unity Catalog pricing"One topic → many websites → the best passages from each, in one reply
web_read"read these 3 pages and focus on pricing"Full text of up to 20 pages or PDFs, or only the parts about a topic
web_map"list all pages on docs.example.com"A site's page addresses
web_crawl"read the pricing pages on example.com"Reads many pages of one site, keeps the relevant ones
web_research"research the top 5 vector databases with sources"A multi-search investigation that returns a written report with numbered sources (takes minutes)

The same abilities work from any terminal:

sh
deepsift search "Databricks Unity Catalog pricing" --advanceddeepsift read https://example.com/page --focus "pricing"deepsift map https://docs.example.comdeepsift crawl https://docs.example.com --instructions "pricing"deepsift research "Which vector databases support hybrid search?"

Install (about 1 minute)

You need a Mac or Linux computer with Claude Code and Python 3.10+.

sh
git clone https://github.com/pavanmulka/deepsift.gitcd deepsift./install.shclaude auth login        # only if you aren't signed in to Claude Code's command line yet

Open a new Claude Code session and ask it to use web_search. That's it.

./uninstall.sh removes it from Claude Code again.

How it compares to Tavily

TavilyDeepSift
CostPay per creditFree (uses your Claude plan)
Speed per search1–2 s~10–30 s through Claude; ~1–3 s on the DuckDuckGo backup
Search, extract, crawl, map, research✓✓
Same request/response format—✓ (optional local HTTP API, see below)
Runs whereTheir serversYour laptop

Limits, honestly:

  • Searches through Claude count toward your Claude plan's usage limits (3 at a time at most). Repeat searches within 24 h come from a local cache.
  • DuckDuckGo pauses you after a burst of quick searches; the tool then rests it for 15 minutes.
  • Pages that only show their text after JavaScript runs come back thin.
  • It's meant for your own personal use with your own Claude subscription. To power an app for other people, use a proper paid API.

Optional: a local Tavily-compatible API

./run.sh starts an HTTP server on 127.0.0.1:8787 with Tavily's paths and fields (/search, /extract, /crawl, /map, /research, GET /research/{id}, /usage). Code written for Tavily can point its base URL there. Every reply reports usage.credits: 0.

Settings

Copy .env.example to .env to change engines, models, cache time, or set an API key for the HTTP server.

How it works

question ─► find sites (Claude WebSearch via `claude -p`, or DuckDuckGo)         ─► download pages in parallel (httpx) ─► readable text (trafilatura, pypdf)         ─► split into passages ─► rank by relevance to the question (BM25) ─► one reply

claude -p always runs on your subscription sign-in. ANTHROPIC_API_KEY is removed before it starts, so it never bills an API account by accident.

Tests

sh
.venv/bin/python -m pytest -q tests

The tests run offline, using a stand-in for claude.

License

MIT

來源：README.md，提交 b37287a

工具

0
該伺服器需要 API 金鑰等憑證，因此 SourceWeft 無法在沒有憑證的情況下讀取其工具，也未收錄。

版本歷史

1
  1. v0.1.0最新Nov 5, 2026

評分

已滿足適用檢查項的 85%

該評分衡量此收錄條目的完整程度，依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價，也不表示伺服器安全或目前可用：可連通性是帶日期的檢查結果，評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通必需25 分
  • 已宣告認證方式必需10 分
  • 已列出工具15 分

    請讓伺服器在無憑證時回應 tools/list，或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分