Eval Harness
affaan-m/ECC/skills/eval-harnessby affaan-mef648e01899ba3e8dc6371642deaaf64b4477775No license275K starsListed Oct 9, 2026Updated Oct 9, 2026Repository updated 4 days ago
Eval-driven development (EDD) framework for AI coding sessions — define capability and regression evals before coding, grade with code-based, model-based, rule, or human graders, and track pass@k and pass^k reliability. Use when defining pass/fail criteria for agent tasks, measuring agent reliability, building regression suites for prompt or agent changes, or benchmarking across model versions.
- ef648e01899ba3e8dc6371642deaaf64b4477775Currentcommit ef648e0Published Oct 9, 2026
Source and attribution
Source:affaan-m/ECCinskills/eval-harnessat commitef648e0
License: No license
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from affaan-m/ECC
Unified Notifications Ops
affaan-m
Designs a unified notification policy that classifies, routes, deduplicates and escalates alerts across GitHub, Linear, hooks and chat.
Verification Loop
affaan-m
Runs a six-phase code verification loop and produces a PASS/FAIL readiness report.
Ui To Vue
affaan-m
Converts batches of UI design screenshots into Vue 3 components using Vant, Element Plus, or Ant Design Vue.
Unified Memory
affaan-m
Guides agents in sharing durable context and handoffs between harnesses through the local ECC Memory Vault.
Visa Doc Translate
affaan-m
OCR-translates visa document images into English and produces a bilingual PDF with the original image and translation.
Team Builder
affaan-m
Interactive picker that discovers agent personas, lets a user select up to five, runs them in parallel on one task, and synthesizes the results.
More in AI & Agents
Discernment Nudge
anthropics
Appends 2-3 specific follow-up questions to substantive answers so users can check facts, reasoning and missing context.
Ppt Template Creator
anthropics
Turns a user's PowerPoint template into a reusable skill that generates branded presentations.
Skill Development
anthropics
Guides creation of Claude Code plugin skills, covering structure, descriptions, progressive disclosure and validation.
Plugin Structure
anthropics
Guides the structure, manifest, and component layout of Claude Code plugins.
Command Development
anthropics
Guides creation of Claude Code slash commands, covering structure, YAML frontmatter, arguments and plugin features.
Claude Md Improver
anthropics
Audits CLAUDE.md files in a repository, scores their quality, and applies approved targeted improvements.