Eval Engine API

io.github.invertedhoologanPublished by GitHub account invertedhoologanv0.1.0Updated Oct 24, 2026

Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.

VerifiedStreamable HTTPWeb executableAI & ML

Overview

AI-generated overview

A remote MCP server that scores LLM outputs against benchmark rubrics using Workers AI, billed per call.

What you can do
Score LLM outputs against benchmark rubrics through Workers AI evaluation calls, run from a remote endpoint with no local install.
When to use it
Useful when you want an assistant to grade or compare model outputs against defined rubrics without building your own evaluation pipeline.
Requirements
A remote MCP endpoint at eval.zuluworksai.com over streamable HTTP; no packages, environment variables or headers are declared. Calls are pay-per-call, so a billing arrangement is implied.
Before you install
The service is pay-per-call, so usage incurs charges. Outputs and rubric content you submit are sent to a third-party service and its Workers AI backend. No authentication is declared, so check how access and billing are tied to your account before relying on it.

Installation

In SourceWeft

  1. Open Eval Engine API in the dashboard and add it to a workspace.
  2. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/io.github.invertedhoologan%2Feval-engine-mcp/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config.

{
  "mcpServers": {
    "eval-engine-api": {
      "type": "http",
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}

Tools

0
SourceWeft has not read this server's tools yet.

Version history

1
  1. v0.1.0LatestSep 16, 2026

Score

67% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listedRequired15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts

    Declare a GitHub repository with a README, or serve resource_documentation in the OAuth protected-resource metadata.

  • LicenseNot applicable

    A hosted service is used under its provider's terms, so no license is expected here. This check is left out of the percentage.