Preference Optimization
by wshobson46891e7e60daNo licenseListed Oct 8, 2026Updated Oct 8, 2026
Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between preference-optimization methods, or when a DPO run needs hyperparameters or debugging.
Only the file list is public. File contents are available once the skill is installed in a workspace.
| Path | Size | Type |
|---|---|---|
| references/method-configs.md | 6.4 KB | text/markdown |
| SKILL.md | 7.7 KB | text/markdown |
Source and attribution
Source:wshobson/agentsinplugins/llm-finetuning/skills/preference-optimizationat commit46891e7
License: No license
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from wshobson/agents
Uv Package Manager
wshobson
Reference guide for using the uv Python package manager for dependencies, virtual environments and project workflows.
Web Component Design
wshobson
Guides building reusable UI components in React, Vue and Svelte, covering composition patterns, CSS-in-JS choices and component API design.
Python Type Safety
wshobson
Guides Python type annotations, generics, protocols, and strict mypy/pyright checking.
Visual Design Foundations
wshobson
Guides typography, color, spacing and iconography decisions for cohesive, accessible visual design systems.
Responsive Design
wshobson
Guides implementation of responsive web layouts using container queries, fluid typography, CSS Grid and breakpoints.
Python Resource Management
wshobson
Guides Python developers in managing resources deterministically with context managers, cleanup patterns, and streaming.
More in AI & Agents
Skill Development
anthropics
Guides creation of Claude Code plugin skills, covering structure, descriptions, progressive disclosure and validation.
Plugin Structure
anthropics
Guides the structure, manifest, and component layout of Claude Code plugins.
Command Development
anthropics
Guides creation of Claude Code slash commands, covering structure, YAML frontmatter, arguments and plugin features.
Claude Md Improver
anthropics
Audits CLAUDE.md files in a repository, scores their quality, and applies approved targeted improvements.
Smb Onboard
anthropics
Guides a small-business owner through first-time setup: connecting tools, running a value-proof recipe, capturing business context, and setting a weekly…
Smb Router
anthropics
Routes a small-business owner's request to the right plugin skill or command and explains what is available.