AimRank

io.aimrankPublished by aimrank.ioOfficial publisherv4.12.0Updated Oct 24, 2026

Read public pairwise-preference rankings and their statistical quality evidence. No API key.

VerifiedStreamable HTTPWeb executableData & AnalyticsAI & ML

Overview

AI-generated overview

Read public pairwise-preference rankings, matchups, and their statistical quality evidence from AimRank.

What you can do
AimRank exposes public ranking data: it fetches rankings, leaderboards, domains, competitions and entity search results, and returns the next pair of entities to evaluate using strategies such as adaptive, swiss or random. It also reports methodology evidence, including inter-annotator agreement statistics, a pairwise-kappa ceiling, Plackett-Luce and CrowdBT audits, and data cards. Prediction and explanation tools return Glicko-2 win probabilities and the underlying inputs, and share-card tools produce ready-to-paste links and embed snippets.
When to use it
Use it when you want an assistant to browse public preference rankings, pull leaderboards or matchups, or inspect the statistical quality behind a ranking before relying on it. It also suits generating shareable ranking cards or prediction explanations for review.
Requirements
A remote streamable HTTP endpoint at app.aimrank.io; no package or local runtime is needed. The description says no API key is required, but several tools note that a missing key is refused on the /mcp/mcp path.
Before you install
Some tools accept an optional api_key; treat it as a secret. Share-card tools return URLs and embed snippets intended for a human to paste elsewhere, so review them before publishing. Prediction tools are read-only and do not record votes.

Installation

In SourceWeft

  1. Open AimRank in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.aimrank%2Faimrank/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "aimrank": {
      "type": "http",
      "url": "https://app.aimrank.io/mcp/public"
    }
  }
}

Tools

21

aimrank_get_daily_pair

Fetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge + a fresh matchup. If the cron hasn't run yet, falls back via ok=False so the agent can use `aimrank_get_matchup` instead. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_key

aimrank_get_ranking

Fetch a ranking's metadata + top 25 entities sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequired

aimrank_get_leaderboard

Get the top N entities of a ranking sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parameterslimitapi_keyranking_idrequired

aimrank_get_matchup

Get the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keystrategyranking_idrequired

aimrank_search_entities

Find entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parameterslimitqueryrequiredapi_keyranking_idrequired

aimrank_create_share_card

Return share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "embed_vote", "badge_markdown", "qr_code", "data_card". Pass these to a human to paste into a tweet, blog, Notion page, or Slack message. The OG image renders automatically when the public_url is unfurled by Twitter / LinkedIn / Slack. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersformatapi_keyranking_idrequired

aimrank_predict_matchup_winner

Predict the winner of a matchup BEFORE a vote is cast. Uses Glicko-2 win probability under the same formula matchmaking uses internally. Pairs with aimrank_submit_vote for the "Claude predicts, you vote, we compare" demo. Does not record a vote — read-only. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequiredentity_a_idrequiredentity_b_idrequired

aimrank_discover_public_rankings

Browse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort ("trending" | "recent" | "most_votes" | "random"), limit 1-50. Each result embeds share assets so the agent can hand any ranking back to the user as a clickable link without a follow-up call. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parameterssortlimitapi_keycategorymedia_type

aimrank_list_domain_entities

List all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keydomain_idrequired

aimrank_get_domain

Get domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keydomain_idrequired

aimrank_list_competitions

List all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keydomain_idrequired

aimrank_get_data_card

Auto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdown audit artefact. Format: 'markdown' (default) or 'json' for structured summary. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersformatapi_keyranking_idrequired

aimrank_get_agreement

Inter-annotator agreement — Layer 5. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plus the multi-rater coverage report. `min_raters` overrides the ranking's configured min_raters_per_pair. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keymin_ratersranking_idrequired

aimrank_get_ceiling

Pairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot refund clause (refund if κ < ceiling - 5pp). api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequiredmin_overlapping_items

aimrank_get_plackett_luce

Plackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's algorithm returns 400. AimRank has 6 rating engines plus 2 offline aggregators (this and CrowdBT) — never describe it as an 8th rating algorithm. Generalises Bradley-Terry to ranked lists. On pairwise data, collapses to BT MLE — useful as a second-opinion aggregator. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequiredmax_iterationsmin_appearances_per_entity

aimrank_get_crowd_bt

CrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, not a live engine. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequiredmax_iterationsmin_votes_per_entitymin_votes_per_annotator

aimrank_list_public_judges

Browse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``fork_count`` (default — most-forked first), ``recent``, ``faithfulness``. Returns artifact summaries WITHOUT the full prompt text — call `aimrank_fork_judge_prompt` or the REST GET to retrieve the full prompt before using it. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parameterssortlimitapi_keycategorydomain_id

aimrank_find_similar_domains

Find public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to find domains similar to one you already know. Exactly one must be provided. TF-IDF + cosine similarity over name + description + category + declared constitution + objectives text. Cheap (no embedding API calls), 5-minute in-process cache. Only public domains are searched / returned. Score in [0, 1] — typical "useful match" threshold is ≥0.15; "near duplicate" is ≥0.5. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parameterslimitqueryapi_keydomain_idmin_score

aimrank_predict

iCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex IV section-4 generator can ingest the response directly. See [iCOMPLY_INTEGRATION_STRATEGY.md] for the contract. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequiredentity_a_idrequiredentity_b_idrequired

aimrank_explain

iCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrative. No LLM-synthesised rationale — these are the actual numbers the math uses, which is exactly what an Annex IV auditor needs to trace. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.

Parametersapi_keyranking_idrequiredentity_a_idrequiredentity_b_idrequired

aimrank_healthcheck

iCOMPLY contract: liveness + DB-connectivity probe.

Takes no parameters.

Version history

1
  1. v4.12.0LatestSep 16, 2026

Score

83% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.