Llama Factory

orchestra-research/ai-research-skills/03-fine-tuning/llama-factory

by orchestra-research773a52944ba4MIT13K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated 3 months ago

Expert guidance for fine-tuning LLMs with LLaMA-Factory - WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, multimodal support

Instructions onlyAI & Agents
AI-generated overview

Provides reference documentation for fine-tuning LLMs with LLaMA-Factory, covering WebUI, QLoRA and multimodal support.

What it does
This skill supplies guidance and reference material for using LLaMA-Factory to fine-tune large language models. It points to bundled documentation files covering getting started, advanced usage, images and other topics, and suggests reading them for detailed information. It is an instructions-only skill with no scripts, and its quick reference section is currently a placeholder.
When to use it
Use it when working with LLaMA-Factory, asking about its features or APIs, implementing or debugging LLaMA-Factory solutions, or learning its best practices. It is aimed at fine-tuning workflows such as LoRA and QLoRA rather than general model serving.
Requirements
No scripts are included; the skill is documentation only. The listed dependencies are llmtuner, torch, transformers, datasets, peft, accelerate and gradio, which would be needed to actually run LLaMA-Factory fine-tuning.

Llama-Factory Skill

Comprehensive assistance with llama-factory development, generated from official documentation.

When to Use This Skill

This skill should be triggered when:

  • Working with llama-factory
  • Asking about llama-factory features or APIs
  • Implementing llama-factory solutions
  • Debugging llama-factory code
  • Learning llama-factory best practices

Quick Reference

Common Patterns

Quick reference patterns will be added as you use the skill.

Reference Files

This skill includes comprehensive documentation in references/:

  • _images.md - Images documentation
  • advanced.md - Advanced documentation
  • getting_started.md - Getting Started documentation
  • other.md - Other documentation

Use view to read specific reference files when detailed information is needed.

Working with This Skill

For Beginners

Start with the getting_started or tutorials reference files for foundational concepts.

For Specific Features

Use the appropriate category reference file (api, guides, etc.) for detailed information.

For Code Examples

The quick reference section above contains common patterns extracted from the official docs.

Resources

references/

Organized documentation extracted from official sources. These files contain:

  • Detailed explanations
  • Code examples with language annotations
  • Links to original documentation
  • Table of contents for quick navigation

scripts/

Add helper scripts here for common automation tasks.

assets/

Add templates, boilerplate, or example projects here.

Notes

  • This skill was automatically generated from official documentation
  • Reference files preserve the structure and examples from source docs
  • Code examples include language detection for better syntax highlighting
  • Quick reference patterns are extracted from common usage examples in the docs

Updating

To refresh this skill with updated documentation:

  1. Re-run the scraper with the same configuration
  2. The skill will be rebuilt with the latest information

Source and attribution

Source:orchestra-research/ai-research-skillsin03-fine-tuning/llama-factoryat commit773a529

License: MIT

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal