Skill Optimizer

by mcollina72b727514771No licenseListed Oct 8, 2026Updated Oct 8, 2026

Optimizes AI skills for activation, clarity, and cross-model reliability. Use when creating or editing skill packs, diagnosing weak skill uptake, reducing regressions, tuning instruction salience, improving examples, shrinking context cost, or setting benchmark/release gates for skills. Trigger terms: skill optimization, activation gap, benchmark skill, with/without skill delta, regression, context budget, prompt salience.

Instructions onlyAI & Agents
AI-generated overview

Optimizes AI skills for activation, clarity, and cross-model reliability through benchmarking and release gates.

What it does
This skill provides a structured optimization loop for AI skill packs: measure baseline versus skill-on behavior, identify failure patterns such as universal failures or regressions, edit for salience, re-run evaluations, and ship with guardrails. It includes rule files covering benchmark loops, activation design, context budget, regression triage, and release gates. It produces improved skill text, benchmark comparisons, and go/no-go release criteria.
When to use it
Use it when creating or editing skill packs, diagnosing weak skill uptake, reducing regressions, tuning instruction salience, improving examples, shrinking context cost, or setting benchmark and release gates for skills.
Requirements
No scripts or external tools are required; it is instructions-only and relies on the agent's ability to read the included rule files.

When to use

Use this skill when you need to:

  • Improve whether a skill is actually applied by models
  • Diagnose why some criteria fail across all models
  • Prevent a skill from making outputs worse
  • Refactor skill text for stronger retrieval under context pressure
  • Build repeatable benchmark loops and release gates

Optimization loop (default workflow)

  1. Measure baseline and skill-on behavior (per model, per scenario, per criterion)
  2. Find failure pattern:
    • universal failure (0% with skill)
    • model-specific weakness
    • regression (negative delta)
  3. Edit for salience:
    • add explicit triggers
    • add concrete integrated examples
    • tighten checklists and decision rules
  4. Re-run evals and compare deltas
  5. Ship with guardrails (documented gate + run history + follow-up issues)

How to use

Read individual rule files for detailed procedures and templates:

  • rules/benchmark-loop.md [blocked] - End-to-end benchmark loop and scoring
  • rules/activation-design.md [blocked] - Improve retrieval and instruction uptake
  • rules/context-budget.md [blocked] - Reduce token cost without losing behavior
  • rules/regression-triage.md [blocked] - Diagnose and fix skill-on regressions
  • rules/release-gates.md [blocked] - Go/no-go criteria before shipping skill updates

Practical heuristics

  • Prefer few high-signal rules over many soft recommendations
  • Put fragile, high-value behaviors in top-level checklists
  • Include at least one integrated example per common scenario
  • Add explicit wording for what must not be omitted
  • Track gains/losses with with-skill vs without-skill comparisons

Source and attribution

Source:mcollina/skillsinskills/skill-optimizerat commit72b7275

License: No license

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal