
ModelPick
io.github.Leizhidong-creator由 GitHub 帳號 Leizhidong-creator 發布v0.1.1更新於 Nov 19, 2026
Pick the best-value model at every task node, with cost per solved task and the exact setup.
概覽
本機 stdio MCP 伺服器,為每個任務節點推薦應使用的 AI 模型,並提供每個已解決任務的成本與接入方式。
- 可以做什麼
- 為任務挑選並比較模型,給出品質、每個已解決任務的成本與替代方案
- 規劃多步驟工作流程,為每一步指定模型,並說明任務是如何被辨識的
- 瀏覽模型目錄並列出支援的任務節點
- 查詢模型的接入資訊:環境變數、金鑰申請網址、文件與 API 模型 id
- 產生供外部評審模型使用的決策包,或用評審結論重新排序候選清單
- 適用情境
- 適合希望為文字、圖像、影片、3D 和音訊等不同步驟分別選擇模型,而不是所有任務都共用同一個前沿模型的場合,也適合需要把品質與成本之間的取捨明確呈現出來的開發者或代理。
- 執行需求
- 透過 npx 以 stdio 在本機執行,需要 Node.js 20.11 或更新版本,沒有執行期相依套件。取得建議不需要帳號、金鑰或網路連線。只有實際呼叫被推薦的模型時才需要各廠商的 API 金鑰;伺服器只回報金鑰是否存在,不會讀取其內容。
安裝
在 SourceWeft 中
- 開啟 儀表板中的 ModelPick,將其新增到工作區。
- 為需要使用其工具的對話啟用該服務。
Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。
其他 MCP 客戶端
參照 儲存庫 中的啟動說明。
README
[ModelPick — pick the right model at every step]
ModelPick
The model router for AI agents — with cost per solved task.
Coding, image, video, 3D, and audio. One CLI, one MCP server, every agent.
[release] [license] [node] [MCP] [tests] [adversarial] [dependencies]
Website · intro video (93s) · How value is defined · Ecosystem
Your agent can write code, call tools, and ship a feature. Then it picks one model for everything — a frontier model to classify a support ticket, to generate a barrel prop, to draft a thumbnail.
The result is predictable: 60–95% of the spend goes to work that did not need a frontier model, and the hard nodes still fail because the model was chosen for the wrong modality.
ModelPick is a router and cost calculator, not another gateway. Before each node, it answers three questions in one call:
- Which model? Ranked for this exact task, with hard capability filters (context, text-in-image, rigging, clip length, open weights).
- What will it really cost? Cost per solved task — list price × expected attempts, not $/M tokens.
- How do I connect it? The env var, key URL, docs, and API model id.
[ModelPick CLI recommending Tripo H3.1 for a 3D game asset]
[Watch the ModelPick intro video]
▶ Watch the intro video with English + 中文 captions · direct MP4 · script & storyboard · English + 中文 captions
Why this exists
Three things are broken in model selection today:
1. Token prices hide the real bill. A model that is 10× cheaper per token but needs 1.8× the attempts and 2× the output tokens is not 10× cheaper. ModelPick computes the denominator that matters: dollars per usable output.
2. A coding agent defaults to one model, even for creative nodes. A 3D pipeline is not a text problem. Text-in-image is not image generation. A 30-second video is not a 5-second clip. ModelPick models 20 task nodes across 5 modalities, with capability filters that reject the wrong model before scoring.
3. Every tool is a new integration. ModelPick ships as a zero-dependency CLI, a stdio MCP server, a portable SKILL.md, and a Claude Code plugin. Same decision engine everywhere; no gateway, no lock-in, no key storage.
In one line: other tools route text prompts. ModelPick routes work — coding, image, video, 3D, and audio — and prices each node per solved task.
How is this different from a gateway or a coding router?
Gateways are useful, and ModelPick can recommend one as the setup path. But a gateway cannot tell you that a 3D node should use Tripo instead of Meshy, or that a "headline text" image needs a model with a text-rendering score above 90. That choice is what this tool makes.
More: research/competitive-landscape.md (15 products, 10 features, 53 sources).
30-second quickstart
Official npm package: https://www.npmjs.com/package/modelpick
MCP Registry: https://registry.modelcontextprotocol.io/v0/servers?search=modelpick
Fallbacks if the registry is unavailable:
[ModelPick planning a product launch video with a model per step]
Works with the agents you already use
modelpick setup writes the files for the agent you use. It backs up existing config, keeps sibling MCP servers, and refuses to overwrite invalid JSON.
Claude Code
Restart Claude Code, run /mcp, and approve the project server. Then ask: pick a model for a 3D sword for Unity.
Plugin alternative, inside Claude Code:
OpenAI Codex CLI
setup codex writes AGENTS.md and .agents/skills/modelpick/. Codex reads MCP servers from ~/.codex/config.toml, so --global --write appends the row or you can use codex mcp add:
Cursor
It writes .cursor/mcp.json, .cursor/rules/modelpick.mdc, .cursor/skills/modelpick/, and AGENTS.md. Open Cursor → Settings → MCP and confirm modelpick is connected.
DeepSeek Harness
DSH has no .mcp.json. MCP servers are Cordis rows in the profile patch:
It writes the portable skill to ~/.dsh/skills/modelpick/, appends AGENTS.md, and adds one MCP row to ~/.dsh/profiles/desktop/cordis.patch.yml (backing the file up first).
Restart DSH after this. Then ask it:
Without --write, setup dsh prints the row instead of editing a live profile. The MCP server itself can be tested without DSH:
GitHub Copilot CLI
It writes .mcp.json, .github/skills/modelpick/, and AGENTS.md. Restart Copilot and ask for a model pick.
VS Code / Copilot agent mode
It writes .vscode/mcp.json under servers (VS Code's schema, not mcpServers), the portable skill, and AGENTS.md. In VS Code run MCP: List Servers, start modelpick, then ask in agent mode. Sibling servers are preserved.
Any MCP client
Tools exposed: pick_model, get_decision_packet, plan_workflow, compare_models, get_setup, list_models, explain_task. Recommendations work without any provider key; the key is only needed to run the chosen model.
Portable skill: .agents/skills/modelpick/SKILL.md is read by Codex, Cursor, Copilot CLI, Devin/Windsurf, and DeepSeek Harness. Claude Code gets its own copy. The skill tells the agent when to call pick_model and how to report the result.
The number that matters: cost per solved task
Worked example — 80K input / 8K output, 60% cache hit, agentic coding:
The cheap model is 53× cheaper and 23.5 quality points worse. The interesting answer is the third row: mid-quality agentic coding at 2.3% of the frontier cost. The right answer depends on the node — which is why the tool shows both sides instead of hiding the trade-off behind a token price.
Quality is a weighted mix of public benchmark signals (BenchLM overall/coding, CursorBench 4.0, capability-specific scores). Expected attempts is a transparent model, shown on every result — not a promise. If a number is estimated, the CLI prints ~.
What it covers
40 models · 18 providers · 20 task nodes · 5 modalities. Current as of 2026-11-19; every price carries a source and read date.
The catalog is a dated snapshot, not a live price feed. modelpick update refreshes from the repo; modelpick doctor warns when it is stale.
Tested decisions
[ModelPick decision benchmark: 115 runs, 100% top-1 acceptable, 100% hard constraints]
What this is: 39 expert-labeled scenarios expanded into balanced/cost/quality runs, plus a 12-scenario held-out set authored after the benchmark froze. Every run checks task detection, top-1/top-3 acceptability, hard constraints, cost regret, and stability under ±20% price perturbation.
What this is not: a live model-output benchmark. It does not call providers, and it does not prove quality labels are universally correct. Quality scores are derived from public leaderboards; expected attempts is a model. The full methodology, failures, and reproduction commands live in tests/TEST_PLAN.md, tests/results/, and bench/.
[Quality versus cost per solved task for coding models]
Full per-node tables: docs/LEADERBOARD.md.
Value, measured
node bench/value.js simulates 4,000 jobs per task across five task types, using catalog quality as first-pass success and the router's retry curve:
The value pick keeps 95.4% of frontier first-pass quality at 41.6% of the cost. The cheapest model saves 2.5 cost points but loses 1.9 quality points and fails a 90%-parity bar on two of five tasks. This is synthetic; the arithmetic and the definition are in docs/VALUE.md, and the evidence behind every quality score is in docs/QUALITY.md.
Multi-dimensional scorecard
tests/results/SCORECARD.md combines six dimensions from committed evidence:
[ModelPick six-dimension scorecard]
Correctness is the decision benchmark; it is not an independent output benchmark. Cost is regret plus the value simulation. Robustness is price perturbation, retry sensitivity, and determinism. Coverage is every task and model. Safety is the 25-case adversarial suite. Operability is p95 latency, modelpick verify, and line coverage (84.8%).
The decision engine
Presets: balanced (task weights), value (price-performance), quality, cost, speed, privacy. Budgets and quality floors are hard constraints, not suggestions.
The default is a value decision, not a bargain hunt. The value pick is the cheapest model within 8 quality points of the best eligible model; if the band is empty, it falls back to the top recommendation. It is returned as picks.value and value, with the quality gap and the percentage of the best model's cost. The full definition, simulation, and sensitivity analysis are in docs/VALUE.md.
Every answer includes:
recommendation.slug,quality,costPerTask,expectedAttempts,latencySecwhy[]andtradeoffs[]setup.direct(env, key URL, docs, API model) and an OpenRouter fallback for text modelscatalog.version,stale,priceConfidence
Bring your own decision model
The deterministic router is the default. If you want a judge or decision model (Claude, GPT, Gemini, a Google decision model, or a local model) to re-rank the shortlist, keep it outside the key store:
judges includes Jev (System One) (jev-latest, Venice, $0.042/1M input) and Gemini Decision 1 (gemini-decision-1, $0.10/1M input, zero output). They are decision models, not generation models.
The verdict can only reorder the shortlist, at most two positions, and cannot
invent a model or override a hard constraint. pick_model accepts the same
verdict object over MCP. The protocol, guardrails, and meta-evaluation
thresholds are in docs/JUDGES.md.
Commands
Useful flags: --optimize, --max-cost, --min-quality, --open-weights, --context, --exclude, --task, --verdict, --json, --explain, --no-color.
Only have a few API keys?
You do not need every provider. ModelPick separates the best decision from what you can run right now:
--availablerestricts ranking to models whose key exists (or any text model if you haveOPENROUTER_API_KEY).- The JSON always includes
availability.bestAvailable,availability.fallbacks, andrecommendation.availability.missing. - An
OPENROUTER_API_KEYis a universal fallback for text models;FAL_KEYcovers many media models. - If a capability has no accessible model, the tool says so instead of inventing a recommendation.
Add your own model
Bring a private endpoint, a self-hosted vLLM/Ollama model, or a provider the catalog does not cover:
The model is written to ~/.modelpick/overrides.json, validated against the full catalog before saving, and never touches the repo. You can also add a whole list with { "models": [...] }.
Connect without guessing the endpoint
pick gives you the env var and key URL. show gives you the full connection card:
The same object is returned by the MCP get_setup tool. If an endpoint is a provider's common path rather than a freshly verified one, the card says so (typical vs verified).
Built to change
Model prices move weekly. New providers appear monthly. The engine is deliberately data-first:
Custom model example:
No fork. No rebuild. modelpick doctor validates the result.
Data, honesty, and limits
- Prices: models.dev / OpenRouter for text; BenchLM media pricing, Google Vertex, OpenAI, fal, Tripo, Meshy, ElevenLabs for media. Read date on every source.
- Quality: BenchLM BenchAlign and CursorBench 4.0 for text; vendor specs plus public comparisons for media. Media quality is the least independently verified part of the catalog; it is labeled and dated.
- Known omissions: Veo is Vertex-only now; Sora 2 is discontinued; GPT-Image-1 and Imagen 4 are retired. These are deliberately not in the catalog.
- No telemetry. No key storage. Recommendations work offline.
keysreads presence only. - Not a gateway. ModelPick does not proxy requests, mark up tokens, or hold your data. You call the provider directly.
See docs/DATA.md for provenance and research/ for the underlying research.
Development
Requirements: Node ≥ 20.11. Runtime dependencies: zero. Python + Pillow are only needed to regenerate images.
- Architecture
- Data provenance
- How value is defined
- Quality evidence
- Media evidence: the first independent correction
- Bring your own eval
- Self-hosting
- NPM mirror
- Live endpoint evidence
- Ecosystem and embedding
- Judge/decision models
- Publishing and launch runbook
- Growth playbook
- Per-node leaderboard
- Model applicability
- Multi-dimensional scorecard
- Adversarial review
- Test form: 20 tasks × 40 models
- Citation metadata
- Design partner program: 5 slots
- Test plan
- Benchmark methodology
- Contributing
- Security
- Changelog
Roadmap
- Publish to npm (
npx modelpick) and submit to MCP directories - Live price refresh from provider APIs with signed snapshots
- Community-contributed task nodes and quality evidence
- Router mode: optionally execute the recommended call through the user's own key
- Cost ledger: track actual spend per node across a project
- Windows-native MCP shim (no
cmd /c)
If ModelPick saves you money, star the repo — it is the only distribution channel for a tool with no VC and no telemetry.
MIT © 2026 Lei Zhidong · built with zero runtime dependencies and a healthy distrust of token pricing.
來源:README.md,提交 6e5821d
工具
0版本歷史
1- v0.1.1最新Nov 19, 2026
評分
已滿足適用檢查項的 50%
該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。
- 近 30 天內可連通25 分
請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。
- 已宣告認證方式10 分
請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。
- 已列出工具15 分
請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。
- 描述必需15 分
- 圖示10 分
- 文件15 分
- 授權條款10 分
其他 Model 整合

model.tools — Zero-Auth Agent Utilities
tools.model官方發布者
零認證遠端工具伺服器,讓代理程式讀取一次性信箱驗證碼、保存檢查點、接收 Webhook、排定喚醒、取得任務回執,並把網頁轉成 Markdown。
NLP.COM.AI Open Model Catalog
ai.com.nlp官方發布者
搜尋精選的開放權重AI模型發布、授權條款、架構和原始來源。AI 翻譯

Hologram Model Hub
foundation.uor.hub官方發布者
一個遠端 MCP 伺服器,讓助理搜尋開放模型索引,並取得附有 SHA-256 校驗值的下載連結。

DOC Model Safety Gate
由 GitHub 帳號 laceykes 發布
本機 MCP 伺服器,將 AI 提出的內容變更暫存待人工審核,只有審核通過的執行才能發布。

MCPShelf Model Context Protocol Registry, Search & Security Auditor
由 GitHub 帳號 RitualDev-Lab 發布
本機 MCP 登錄目錄瀏覽工具,讓助理搜尋、比較 400 多個 MCP 伺服器的信任評分並取得安裝設定片段。