Openlayer

com.openlayerPublished by openlayer.comOfficial publisherv0.16.1Updated Oct 27, 2026

Inspect AI projects, traces, tests, and governance rules in Openlayer, and debug failing evals.

VerifiedStreamable HTTPWeb executableDeveloper ToolsSecurity & MonitoringAI & ML

Overview

AI-generated overview

Hosted Openlayer MCP server that lets an assistant inspect AI projects, traces, tests and governance rules, and debug failing evals.

What you can do
  • Read projects, data sources, traces, tests, results and governance rules in a chosen workspace
  • Create or update those projects, tests and governance rules when asked
  • Debug failing tests through the Openlayer fix-loop
  • Look up Openlayer documentation and query pipelines and test results
When to use it
Useful when you build or maintain LLM and agent applications on Openlayer and want an assistant to inspect evaluation results, trace production behavior, or work through failing tests without switching to the web app.
Requirements
Remote streamable HTTP endpoint at mcp.openlayer.com; an Openlayer account, with OAuth sign-in and workspace selection on first tool use. The companion skills package also expects an OPENLAYER_API_KEY, and self-hosted deployments point the server at their own URL.
Before you install
The assistant can create, update and delete workspace objects such as projects, tests and governance rules; the README says write and delete tools ask for confirmation, so review those prompts. Tool calls go only to Openlayer's API. Access is scoped to the workspace you pick at sign-in.

Installation

In SourceWeft

  1. Open Openlayer in the dashboard and add it to a workspace.
  2. Connect the required credentials. They are stored privately and never shown on public pages.
  3. Enable the server for the chats that should use its tools.

Web executable via Streamable HTTP. Remote servers run from the web runtime once configured in a workspace.

Use with an agent

Paste this prompt into Claude Code, Codex, Cursor or another agent — or into SourceWeft chat. The agent reads this server's install guide, shows you its publisher, endpoint and sign-in, and adds it to your client once you agree. Keys never go into a command.

Read https://sourceweft.com/mcp/com.openlayer%2Fmcp/install.md and connect the MCP server it describes to my client. Before changing any config, show me its publisher, endpoint and sign-in method and wait for my OK. Never put an API key in a command or in a file I would commit; ask me where it should come from.

Read the install guide the agent follows

Other MCP clients

Add this to your client's mcpServers config. The client completes OAuth sign-in on first connect.

{
  "mcpServers": {
    "openlayer": {
      "type": "http",
      "url": "https://mcp.openlayer.com/mcp"
    }
  }
}

README

Openlayer Skills

Agent Skills that teach AI coding assistants (Claude Code, Cursor, GitHub Copilot, etc.) how to integrate apps with Openlayer — the AI evaluation and observability platform.

Coding agents produce significantly better results with the skill installed, because they are conditioned to follow Openlayer's current best practices instead of guessing from memory (outdated SDK calls, wrong env vars, invented test configs).

Skills

SkillDescription
openlayerMain skill. Instrument code with tracing (monitoring), set up offline openlayer.json + tests.json evals (development), create tests/guardrails, gate CI/CD, run the MCP fix-loop, and access data and docs.

Installation

Claude Code plugin

bash
claude plugin marketplace add openlayer-ai/openlayer-skillsclaude plugin install openlayer@openlayer

Cursor plugin

/add-plugin openlayer

GitHub Copilot

GitHub Copilot reads .github/plugin/plugin.json and the same skills and .mcp.json as Claude Code.

In VS Code, add the marketplace to your settings.json, then install Openlayer from the Extensions view (search @agentPlugins):

json
{  "chat.plugins.marketplaces": ["openlayer-ai/openlayer-skills"]}

In the Copilot CLI:

bash
copilot plugin marketplace add openlayer-ai/openlayer-skillscopilot plugin install openlayer@openlayer

Other agents

Codex, Gemini CLI, Windsurf, opencode, and dozens more install through the skills CLI:

bash
npx skills add openlayer-ai/openlayer-skills --skill "openlayer"

For claude.ai, Copilot's cloud coding agent and code review, a manual symlink, or anything else, see the installation guide — it is the source of truth and stays current as these tools change.

Prerequisites

An Openlayer account and an API key:

bash
export OPENLAYER_API_KEY=...# self-hosted / local only:export OPENLAYER_BASE_URL=https://api.openlayer.com/v1

Find your API key in the Openlayer app under Workspace settings → API keys (see https://docs.openlayer.com/workspace-and-projects/find-your-api-key).

Usage

Once installed, the agent uses the skill automatically when relevant — for example:

  • Adding Openlayer tracing/monitoring to an LLM or agent app
  • Setting up offline evals (openlayer.json + tests.json) and pushing commits
  • Creating tests from the catalog and configuring guardrails
  • Gating CI/CD on eval results
  • Debugging failing tests via the Openlayer MCP fix-loop
  • Querying projects, pipelines, test results, or looking up Openlayer docs

MCP server

The plugin also connects your agent to the hosted Openlayer MCP server at https://mcp.openlayer.com/mcp (US accounts on app.openlayer.com; this is the .mcp.json default). The first time a tool is used, you sign in to Openlayer with OAuth and pick a workspace. The agent can then read projects, data sources, traces, tests, results, and governance rules in that workspace, and create or update them when you ask. Write and delete tools ask for confirmation.

EU accounts (eu.openlayer.com) must use https://mcp-eu.openlayer.com/mcp. Each hosted MCP server only accepts tokens from its own region's API, so an EU account pointed at the US server fails OAuth. Outside the regional cloud hosts the default stays https://mcp.openlayer.com/mcp.

Tool calls go only to Openlayer's API. Nothing is sent anywhere else. See the privacy policy. Self hosted deployments should point the server at their own URL, as the MCP docs describe.

Feedback & Requests

Something not working as expected, or want a new use case covered? Open an issue at https://github.com/openlayer-ai/openlayer-skills/issues or email [email protected].

Source: README.md at commit 3ee3885

Tools

0
This server asks you to sign in, so SourceWeft could not read its tools without an account and has not indexed them. What a connected account sees can depend on that account and its permissions.

Version history

1
  1. v0.16.1LatestOct 20, 2026

Score

85% of the applicable checks met

How complete this listing is, computed from the registry entry, the endpoint and public sources. Not a rating of the server and not a statement that it is safe or working today: reachability is a dated check, and no installs or reviews go into the score.

  • Reached in the last 30 daysRequired25 pts
  • Auth declaredRequired10 pts
  • Tools listed15 pts

    Answer tools/list without a credential, or ship a package that starts in a sandbox without one.

  • DescriptionRequired15 pts
  • Logo10 pts
  • Documentation15 pts
  • License10 pts