
AgentTrust
io.github.assister-xyz由 GitHub 帳號 assister-xyz 發布v0.1.2更新於 Oct 24, 2026
Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.
概覽
AgentTrust 用來評估其他 AI 代理與 MCP 伺服器的品質,依六個面向評分並簽發可驗證憑證作為證明。
- 可以做什麼
- 對目標 MCP 伺服器執行完整品質評估:清單驗證、功能工具呼叫與評審評分,涵蓋六個加權面向,並包含提示注入、PII 外洩、幻覺等對抗性探測。取得快速快取分數或僅依清單的分數,或查詢既有分數並考量時效衰減。驗證 AQVC 憑證權杖並解碼其內容。工具背後還有對戰競技場排名、自適應 IRT 測試,以及用於評估、排行榜、徽章和憑證的 HTTP API。
- 適用情境
- 適合在把實際任務交給第三方代理或 MCP 伺服器之前先做信任檢查,或需要為自己發布的伺服器提供可驗證的簽章品質憑證時使用。
- 執行需求
- 以本機 Python 程序執行(PyPI 套件 mcp-agenttrust,stdio),也可用 Docker 部署。至少需要一個 LLM 服務商金鑰(CEREBRAS_API_KEY 或 GROQ_API_KEY,README 另列出更多備援)以及 MongoDB 連線位址(MONGODB_URL);完整部署還會用到 Redis。需要連線至目標伺服器與 LLM 服務商的網路。
安裝
在 SourceWeft 中
- 開啟 儀表板中的 AgentTrust,將其新增到工作區。
- 為需要使用其工具的對話啟用該服務。
Desktop only,透過 STDIO。 STDIO 服務會啟動本機處理程序,因此需要 SourceWeft 桌面主機。
其他 MCP 客戶端
參照 儲存庫 中的啟動說明。
README
AgentTrust
Challenge-response quality verification for AI agents and MCP servers.
AgentTrust evaluates AI agent competency before you trust them with real tasks or payments. It connects to any MCP server, runs challenge-response tests across 6 quality dimensions, and issues W3C Verifiable Credentials as proof.
Why
The AI agent ecosystem has identity (ERC-8004, SATI), post-hoc reputation (TARS, Amiko), and payments (x402) — but no pre-payment quality gate. AgentTrust fills this gap: verify competency first, then trust.
Features
Evaluation Engine
- 3-level pipeline: Manifest (schema) → Functional (tool calls) → Domain Expert (calibrated questions)
- 6-axis scoring: accuracy (35%), safety (20%), reliability (15%), process quality (10%), latency (10%), schema quality (10%)
- Consensus judging: 2-3 LLM judges in parallel with agreement threshold (saves 50-66% LLM calls)
- 7 LLM provider fallback chain: Cerebras → Groq → OpenRouter → Gemini → Mistral → DeepSeek → OpenAI
- 5 adversarial probe types: prompt injection, PII leakage, hallucination, overflow, system prompt extraction
Battle Arena
- Head-to-head blind evaluation with position-swap consistency
- OpenSkill (Bayesian ELO) rating system with divisions (Bronze → Grandmaster)
- Fair matchmaking: rating proximity + uncertainty bonus + cross-division challenges
- Style control penalties to prevent gaming via verbose/formatted responses
IRT Adaptive Testing
- Rasch 1PL calibration from battle data (pure Python, no numpy)
- Fisher information maximization for adaptive question selection
- EAP ability estimation with standard normal prior
- Reduces evaluation cost by 50-90% while maintaining accuracy
Standards
- W3C Verifiable Credentials (AQVC format) with Ed25519 DataIntegrityProof
- Google A2A v0.3 native support (AgentTrust IS an A2A agent)
- x402 Solana payment verification (USDC + SOL)
- AIUC-1 protocol mapping
Quick Start
Docker (recommended)
Services:
- API: http://localhost:8002
- MCP Server: http://localhost:8003
- Health: http://localhost:8002/health
Local Development
MCP Server (for Claude, Cursor, Windsurf)
Add to your MCP client config:
Or connect to a running instance via SSE:
Available MCP tools:
API Endpoints
Architecture
Stack: FastAPI + MongoDB + Redis | 533 tests | 60 source files | 15 lean dependencies
Tests
Configuration
See .env.example for all 60+ configuration options including:
- LLM API keys (7 providers, comma-separated for rotation)
- MongoDB/Redis connection
- JWT attestation (Ed25519 key, issuer DID, validity)
- Solana wallet for x402 payments
- Rate limit tiers and consensus judge settings
License
MIT
Links
- Architecture — Full system design (845 lines)
- Distribution Roadmap — Partner and integration plan
- A2A Agent Card — Machine-readable capabilities
Built by Assisterr
來源:README.md,提交 6152a08
工具
0版本歷史
1- v0.1.2最新Sep 16, 2026
評分
已滿足適用檢查項的 50%
該評分衡量此收錄條目的完整程度,依據註冊中心條目、端點與公開來源計算得出。它不是對伺服器本身的評價,也不表示伺服器安全或目前可用:可連通性是帶日期的檢查結果,評分也不包含安裝量或使用者評價。
- 近 30 天內可連通25 分
請保持端點能夠回應 MCP 握手;SourceWeft 每 30 天探測一次。
- 已宣告認證方式10 分
請在註冊中心條目中宣告憑證請求標頭,或保持端點能夠回應探測,以便判定其認證方式。
- 已列出工具15 分
請讓伺服器在無憑證時回應 tools/list,或發布可在沙箱中無憑證啟動的軟體包。
- 描述必需15 分
- 圖示10 分
- 文件15 分
- 授權條款10 分