Evals Start

ai-evals-course/evals-skills/skills/evals-start

作者 ai-evals-course80d5f7b0127c7572ed9e9339937adbfd7240ffeb无许可证1.4K 个星标收录于 2026年10月9日更新于 2026年10月9日仓库2周前更新

Entry point for evals. Use when the user asks for help with evals, does not know where to begin, or asks for something no other skill in this plugin matches. Do NOT use when a more specific skill in this plugin already matches; load that skill directly.

仅含说明AI & Agents
AI 生成的概览

将评估相关请求路由到同一插件中合适的专用技能。

功能
该技能是评估工作的入口点。它提供一张表格,将用户情况映射到具体技能,例如错误发现、评估审计、代码评估编写、评判提示编写、评估器验证、合成数据生成、审查界面构建和 RAG 评估。它会告知用户正在加载哪个技能及原因,然后移交到该技能的工作流。它仅包含路由说明,本身不产生任何产物。
适用场景
当用户请求评估方面的帮助、不知道从何入手,或请求插件中没有其他技能匹配的内容时使用。当插件中已有更具体的技能匹配时不要使用;应直接加载该技能。
运行要求
不需要脚本或工具;它是一份仅含说明的路由文档。

Evals Start

This plugin splits eval work into targeted skills. Your job here is small: find the row below that matches the user's situation, tell the user which skill you are loading and why, then load that skill and follow its workflow from start to finish instead of improvising your own version of it.

SituationSkill to load
Has traces, wants to find failure modes, no established taxonomy yeterror-discovery
Has an existing eval pipeline and wants to know if it can be trustedeval-audit
Has a known failure mode that code can check (e.g., format, schema, regex, execution)write-code-eval
Has a known failure mode and wants an LLM judge for itwrite-judge-prompt
Has an LLM judge or evaluator and wants to check its qualityvalidate-evaluator
Has no traces to review yetgenerate-synthetic-data, then error-discovery
Wants a custom annotation interface for some other labeling taskbuild-review-interface
Wants to evaluate a RAG pipelineevaluate-rag

Most requests that mention error analysis with traces in hand mean error-discovery. New users with an existing pipeline usually need eval-audit first. This file holds only routing. When in doubt about which row fits, ask the user instead of guessing. The workflow lives in the targeted skill.

来源与署名

来源:ai-evals-course/evals-skills位于skills/evals-start提交80d5f7b

许可证: 无许可证

内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。

举报或申请下架