Ai Eval

io.github.lazymac2xPublished by GitHub account lazymac2xv1.0.0Updated Oct 24, 2026

Cloudflare Workers MCP server: ai-eval

VerifiedStreamable HTTPWeb executableData & AnalyticsAI & ML

Overview

AI-generated overview

A remote MCP server that scores and compares AI responses with heuristic metrics and reports text quality statistics.

What you can do
Score a single AI response against a prompt using heuristic metrics such as length, relevance, structure and completeness. Compare and rank several responses to the same prompt. Get text quality metrics including word count, sentence count, estimated tokens and readability grade.
When to use it
Useful when you want a quick, rule-based sanity check of model outputs, such as ranking candidate answers to one prompt or checking length, token estimates and readability before shipping text.
Requirements
A remote endpoint at api.lazy-mac.com; no packages, environment variables or headers are declared, and no authentication is declared. Network access to the endpoint is needed.
Before you install
Scoring is heuristic rather than model-based, so treat scores as rough signals. Prompts and responses you submit are sent to a third-party hosted service, so avoid confidential text.

Installation

In SourceWeft

  1. Open Ai Eval in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.github.lazymac2x%2Fai-eval/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "ai-eval": {
      "type": "http",
      "url": "https://api.lazy-mac.com/ai-eval/mcp"
    }
  }
}

README

ai-eval-api

Cloudflare Workers MCP server: ai-eval. REST + MCP (JSON-RPC 2.0). Live: api.lazy-mac.com/ai-eval

Source: README.md at commit 7067590

Tools

3

score_response

Score an AI response against a prompt using heuristic metrics (length, relevance, structure, completeness)

Parameterspromptrequiredcriteriaresponserequired

compare_responses

Compare and rank multiple AI responses to the same prompt

Parameterspromptrequiredresponsesrequired

text_metrics

Get text quality metrics: word count, sentence count, estimated tokens, readability grade

Parameterstextrequired

Version history

1
  1. v1.0.0LatestSep 16, 2026

Score

90% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts
  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts

    Declare a license in the repository or the registry entry.