AimRank

io.aimrank由 aimrank.io 发布官方发布者v4.12.0更新于 Oct 24, 2026

Read public pairwise-preference rankings and their statistical quality evidence. No API key.

已验证Streamable HTTP可网页运行数据与分析AI 与机器学习

概览

AI 生成的概览

从 AimRank 读取公开的成对偏好排名、对局及其统计质量证据。

可以做什么
AimRank 提供公开排名数据:可获取排名、排行榜、领域、竞赛和实体搜索结果,并按 adaptive、swiss、random 等策略返回下一对待评估实体。它还提供方法学证据,包括评分者间一致性统计、成对 kappa 上限、Plackett-Luce 与 CrowdBT 审计以及数据卡。预测与解释工具返回 Glicko-2 胜率概率及其底层输入,分享卡工具生成可直接粘贴的链接和嵌入片段。
适用场景
当需要助手浏览公开偏好排名、获取排行榜或对局,或在依赖某排名前查看其统计质量时使用。也适合生成可分享的排名卡片或供审阅的预测解释。
运行要求
远程 streamable HTTP 端点 app.aimrank.io,无需安装包或本地运行时。描述称不需要 API 密钥,但多个工具说明在 /mcp/mcp 路径上缺少密钥会被拒绝。
安装前请注意
部分工具接受可选的 api_key,应视为机密。分享卡工具返回供人工粘贴到别处的链接和嵌入片段,发布前请先检查。预测工具为只读,不会记录投票。

安装

在 SourceWeft 中

  1. 打开 控制台中的 AimRank,将其添加到工作区。
  2. 为需要使用其工具的对话启用该服务。

Web executable,通过 Streamable HTTP。 远程服务在工作区中配置后即可从网页运行时运行。

交给智能体安装

把这段提示词粘贴到 Claude Code、Codex、Cursor 等智能体,或 SourceWeft 对话中。智能体会读取该服务器的安装指南,先向你展示发布者、端点和登录方式,经你同意后再把它添加到你的客户端。密钥不会写进任何命令。

阅读 https://sourceweft.com/mcp/io.aimrank%2Faimrank/install.md,并按其中说明把这个 MCP 服务器接入我的客户端。修改任何配置之前,先告诉我它的发布者、端点和登录方式,等我确认。不要把 API 密钥写进命令或我会提交的文件;问我密钥应从哪里获取。

查看智能体所依据的安装指南

其他 MCP 客户端

把它添加到你客户端的 mcpServers 配置中。

{
  "mcpServers": {
    "aimrank": {
      "type": "http",
      "url": "https://app.aimrank.io/mcp/public"
    }
  }
}

工具

21

aimrank_get_daily_pair

Fetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge + a fresh matchup. If the cron hasn't run yet, falls back via ok=False so the agent can use `aimrank_get_matchup` instead. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_key

aimrank_get_ranking

Fetch a ranking's metadata + top 25 entities sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填

aimrank_get_leaderboard

Get the top N entities of a ranking sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数limitapi_keyranking_id必填

aimrank_get_matchup

Get the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keystrategyranking_id必填

aimrank_search_entities

Find entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数limitquery必填api_keyranking_id必填

aimrank_create_share_card

Return share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "embed_vote", "badge_markdown", "qr_code", "data_card". Pass these to a human to paste into a tweet, blog, Notion page, or Slack message. The OG image renders automatically when the public_url is unfurled by Twitter / LinkedIn / Slack. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数formatapi_keyranking_id必填

aimrank_predict_matchup_winner

Predict the winner of a matchup BEFORE a vote is cast. Uses Glicko-2 win probability under the same formula matchmaking uses internally. Pairs with aimrank_submit_vote for the "Claude predicts, you vote, we compare" demo. Does not record a vote — read-only. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填entity_a_id必填entity_b_id必填

aimrank_discover_public_rankings

Browse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort ("trending" | "recent" | "most_votes" | "random"), limit 1-50. Each result embeds share assets so the agent can hand any ranking back to the user as a clickable link without a follow-up call. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数sortlimitapi_keycategorymedia_type

aimrank_list_domain_entities

List all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keydomain_id必填

aimrank_get_domain

Get domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keydomain_id必填

aimrank_list_competitions

List all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keydomain_id必填

aimrank_get_data_card

Auto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdown audit artefact. Format: 'markdown' (default) or 'json' for structured summary. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数formatapi_keyranking_id必填

aimrank_get_agreement

Inter-annotator agreement — Layer 5. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plus the multi-rater coverage report. `min_raters` overrides the ranking's configured min_raters_per_pair. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keymin_ratersranking_id必填

aimrank_get_ceiling

Pairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot refund clause (refund if κ < ceiling - 5pp). api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填min_overlapping_items

aimrank_get_plackett_luce

Plackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's algorithm returns 400. AimRank has 6 rating engines plus 2 offline aggregators (this and CrowdBT) — never describe it as an 8th rating algorithm. Generalises Bradley-Terry to ranked lists. On pairwise data, collapses to BT MLE — useful as a second-opinion aggregator. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填max_iterationsmin_appearances_per_entity

aimrank_get_crowd_bt

CrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, not a live engine. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填max_iterationsmin_votes_per_entitymin_votes_per_annotator

aimrank_list_public_judges

Browse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``fork_count`` (default — most-forked first), ``recent``, ``faithfulness``. Returns artifact summaries WITHOUT the full prompt text — call `aimrank_fork_judge_prompt` or the REST GET to retrieve the full prompt before using it. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数sortlimitapi_keycategorydomain_id

aimrank_find_similar_domains

Find public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to find domains similar to one you already know. Exactly one must be provided. TF-IDF + cosine similarity over name + description + category + declared constitution + objectives text. Cheap (no embedding API calls), 5-minute in-process cache. Only public domains are searched / returned. Score in [0, 1] — typical "useful match" threshold is ≥0.15; "near duplicate" is ≥0.5. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数limitqueryapi_keydomain_idmin_score

aimrank_predict

iCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex IV section-4 generator can ingest the response directly. See [iCOMPLY_INTEGRATION_STRATEGY.md] for the contract. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填entity_a_id必填entity_b_id必填

aimrank_explain

iCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrative. No LLM-synthesised rationale — these are the actual numbers the math uses, which is exactly what an Annex IV auditor needs to trace. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

输入参数api_keyranking_id必填entity_a_id必填entity_b_id必填

aimrank_healthcheck

iCOMPLY contract: liveness + DB-connectivity probe.

无需输入参数。

版本历史

1
  1. v4.12.0最新Sep 16, 2026

评分

已满足适用检查项的 83%

该评分衡量此收录条目的完整程度,依据注册中心条目、端点与公开来源计算得出。它不是对服务器本身的评价,也不表示服务器安全或当前可用:可连通性是带日期的检查结果,评分也不包含安装量或用户评价。

  • 近 30 天内可连通必需25 分
  • 已声明认证方式必需10 分
  • 已列出工具必需15 分
  • 描述必需15 分
  • 图标10 分
  • 文档15 分

    请声明包含 README 的 GitHub 仓库,或在 OAuth 受保护资源元数据中提供 resource_documentation。

  • 许可证不适用

    托管服务按其提供方的条款使用,因此这里不要求许可证。此检查项不计入百分比。