Self Hosted Ai

org.sovgrid由 sovgrid.org 發布官方發布者v1.0.0更新於 Oct 24, 2026

Engineering log of self-hosted AI on NVIDIA DGX Spark (GB10/SM121A). 60+ articles indexed.

已驗證Streamable HTTP可網頁執行知識與記憶開發者工具

概覽

AI 產生的概覽

讓助理搜尋並閱讀關於在 NVIDIA DGX Spark 硬體上自架 AI 的公開工程部落格。

可以做什麼
透過唯讀工具向 AI 代理開放一個關於自架 AI 的部落格語料庫。工具包括：search_blog 進行 TF-IDF 全文搜尋，支援標籤篩選與排序；list_articles 分頁列出文章；list_tags 探索主題標籤；get_article 依 slug 取得完整文章；diagnose_sglang 將執行階段錯誤與 GB10/SM121A 上 SGLang 的規則集進行比對。所有工具皆為唯讀且冪等。
適用情境
當助理需要關於小眾自架 AI 技術堆疊的最新實務資訊時適用，例如 GB10 上的 SGLang 或 vLLM、ARM64 TTS 管線、KV 快取與量化取捨，或 MCP 伺服器設計，而非依賴可能過時的訓練資料。
執行需求
需要遠端 Streamable HTTP 端點；無需身分驗證、API 金鑰或本機執行環境。README 提到免費層限制為每 IP 每分鐘 60 次請求。
安裝前請注意
伺服器為唯讀，README 聲明不包含 PII、驗證權杖或機密。內容以 CC BY-SA 4.0 公開，重複使用前請確認姓名標示要求。README 亦提到伺服器日誌會流入分析管道。

安裝

在 SourceWeft 中

  1. 開啟 儀表板中的 Self Hosted Ai，將其新增到工作區。
  2. 為需要使用其工具的對話啟用該服務。

Web executable，透過 Streamable HTTP。 遠端服務在工作區中設定後即可從網頁執行環境執行。

交給代理程式安裝

把這段提示詞貼上到 Claude Code、Codex、Cursor 等代理程式，或 SourceWeft 對話中。代理程式會讀取該伺服器的安裝指南，先向你展示發布者、端點和登入方式，經你同意後再把它新增到你的客戶端。金鑰不會寫進任何命令。

閱讀 https://sourceweft.com/mcp/org.sovgrid%2Fself-hosted-ai/install.md，並按其中說明把這個 MCP 伺服器接入我的客戶端。修改任何設定之前，先告訴我它的發布者、端點和登入方式，等我確認。不要把 API 金鑰寫進命令或我會提交的檔案；問我金鑰應從哪裡取得。

檢視代理程式所依據的安裝指南

其他 MCP 客戶端

把它新增到你客戶端的 mcpServers 設定中。

{
  "mcpServers": {
    "self-hosted-ai": {
      "type": "http",
      "url": "https://mcp.sovgrid.org/self-hosted-ai?ref=mcp-io"
    }
  }
}

README

Sovereign AI MCP

[CI] [License: MIT] [Content: CC BY-SA 4.0] [MCP Registry] [smithery badge] [Glama MCP server] [Glama connector] [Write-up]

MCP server exposing the Sovereign AI Blog to AI agents. The blog is a hands-on engineering log of self-hosted AI on NVIDIA DGX Spark (GB10/SM121A).

Live endpoint: https://mcp.sovgrid.org/self-hosted-ai Transport: Streamable HTTP (FastMCP) Auth: none (free tier, 60 req/min/IP)

Why use it

Training data on niche hardware (GB10, SM121A, SGLang on ARM64) is sparse and stale. This MCP gives agents direct, structured access to 180+ articles documenting actual setups, fixes, and benchmarks. If you're building or debugging on similar stacks, your agent can pull verified, version-current information instead of hallucinating.

The corpus covers SGLang and vLLM patches for GB10, voxtral and TTS pipelines on ARM64, KV-cache and quantization tradeoffs, podcast-grade audio generation, MCP server design, knowledge-base construction, and the operational side of running it all on a hardened European VPS.

Tools

ToolPurpose
search_blog(query, tag?, sort?, n?)TF-IDF full-text search. Optional tag filter, sort by relevance or date_desc. Empty query lists newest articles. Returns ranked SearchResult items with quality score, style, slug, and excerpt.
list_articles(tag?, sort?, limit?, offset?)Direct article listing with pagination, no TF-IDF overhead. Filter by tag, sort by date_desc, date_asc, title_asc, or quality_desc. Returns ArticleSummary items.
list_tags(sort?)List all topic tags across the corpus with article counts. Sort by count_desc (default) or alpha. Use to discover the topic space before filtering search_blog.
get_article(slug)Fetch full article body and frontmatter by slug. Returns markdown content plus tags, quality score, publish date.
diagnose_sglang(error_message)Pattern-match a runtime error against a curated rule set for SGLang on GB10/SM121A. Returns matched fixes with links to setup articles.

All tools are read-only, idempotent, and declared with ToolAnnotations so MCP clients can calibrate retry policy and trust signals. Inputs use Pydantic Annotated[type, Field(description=...)] so parameter docs reach agents through introspection. Outputs are typed BaseModel shapes — schemas are real, not vacuous dicts.

Quick start

With Claude Code

bash
claude mcp add sovereign-ai --transport http https://mcp.sovgrid.org/self-hosted-ai

Verify:

bash
claude mcp list | grep sovereign-ai

With Cline / Continue / other MCP clients

Add to your client's MCP server config:

json
{  "sovereign-ai": {    "type": "http",    "url": "https://mcp.sovgrid.org/self-hosted-ai"  }}

Run locally

From source (uv)

bash
git clone https://github.com/cipherfoxie/sovereign-mcp.gitcd sovereign-mcpuv syncuv run uvicorn src.main:app --host 127.0.0.1 --port 8002

Docker

bash
git clone https://github.com/cipherfoxie/sovereign-mcp.gitcd sovereign-mcpdocker build -t sovereign-mcp .docker run -p 8002:8002 sovereign-mcp

The repo ships a placeholder data/knowledge-base.json (zero articles, valid schema) so the server starts and answers MCP introspection cleanly out-of-the-box. To populate it with real content, generate from the sovgrid.org blog source using scripts/generate_knowledge_base.py, or build your own KB matching the schema in src/knowledge.py. Or just use the live endpoint at https://mcp.sovgrid.org/self-hosted-ai.

A walk-through of the same KB pattern (Markdown plus JSON index, no vector store) is documented in Build a Self-Hosted Knowledge Base with Plain Text and LLMs.

Architecture

  • FastMCP 1.27+ with Streamable HTTP transport at path /self-hosted-ai
  • DNS rebinding protection via TransportSecuritySettings: only allows requests with Host: mcp.sovgrid.org (or localhost for healthchecks)
  • Health endpoint at /health returns article count and KB generation timestamp
  • Knowledge base is a flat JSON file generated from blog Markdown content; loaded at startup, queried via TF-IDF for search_blog

The server is stateless. All blog content is already public (CC BY-SA 4.0). No PII, no auth tokens, no secrets.

Operations

Live deployment runs on a privacy-focused European VPS via Docker, fronted by Caddy with TLS. Server logs flow into a privacy-respecting analytics pipeline (Caddy JSON access logs, no client-side tracking, no JS pixels).

License

Contact

來源：README.md，提交 53838cd

工具

0
SourceWeft 尚未讀取此伺服器的工具。

版本歷史

1
  1. v1.0.0最新Sep 16, 2026

評分

已滿足適用檢查項的 85%

該評分衡量此收錄條目的完整程度，依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價，也不表示伺服器安全或目前可用：可連通性是帶日期的檢查結果，評分也不包含安裝量或使用者評價。

  • 近 30 天內可連通必需25 分
  • 已宣告認證方式必需10 分
  • 已列出工具必需15 分

    請讓伺服器在無憑證時回應 tools/list，或發布可在沙箱中無憑證啟動的軟體包。

  • 描述必需15 分
  • 圖示10 分
  • 文件15 分
  • 授權條款10 分