Indexion Segment

作者 trkbt107ad5ad35a668无许可证2 个星标收录于 2026年10月8日更新于 2026年10月8日仓库2周前更新

Split text into contextual chunks for RAG/embedding pipelines. Document segmentation and section extraction using window, tfidf, punctuation, or hybrid strategies chosen by intent.

仅含说明AI & Agents

AI 生成的概览

使用窗口、TF-IDF、标点或混合策略将文本切分为上下文分块，用于 RAG 和嵌入流程。

功能: 该技能将文本文档切分为较小的上下文分块，供检索增强生成或嵌入流程使用。它提供窗口散度、TF-IDF、标点以及 NCD+TF-IDF 混合策略，并可调整分块大小、阈值和窗口大小。输出写入指定目录，文件名前缀可配置。
适用场景: 当需要为 RAG 或嵌入流程切分文本，或需要将文档拆分为有意义的章节时使用。它也适合为子文档级相似度分析准备文本。
运行要求: 需要带有 segment 子命令的 indexion 命令行工具；该技能不附带脚本。输入为文本文件，输出为目录。

indexion segment

Split text into contextual segments using divergence-based, TF-IDF, or punctuation strategies.

When to Use

User needs to chunk text for RAG or embedding pipelines
User wants to split a document into meaningful sections
User asks to segment text for processing
Preparing text for similarity analysis at sub-document level

Usage

bash

# Default window divergence strategyindexion segment <input-file> <output-dir>
# TF-IDF based segmentationindexion segment --strategy=tfidf <input-file> <output-dir>
# Punctuation-based segmentationindexion segment --strategy=punctuation <input-file> <output-dir>
# Custom segment sizesindexion segment --min-size=200 --max-size=3000 --target-size=800 document.txt output/
# Custom divergence thresholdindexion segment --threshold=0.5 document.txt output/
# Adaptive threshold mode (default)indexion segment --adaptive document.txt output/
# Hybrid NCD+TF-IDF modeindexion segment --hybrid --ncd-weight=0.6 --tfidf-weight=0.4 document.txt output/
# Custom window sizeindexion segment --window-size=5 document.txt output/
# Custom output prefixindexion segment --prefix=chunk document.txt output/

# Default window divergence strategyindexion segment <input-file> <output-dir>
# TF-IDF based segmentationindexion segment --strategy=tfidf <input-file> <output-dir>
# Punctuation-based segmentationindexion segment --strategy=punctuation <input-file> <output-dir>
# Custom segment sizesindexion segment --min-size=200 --max-size=3000 --target-size=800 document.txt output/
# Custom divergence thresholdindexion segment --threshold=0.5 document.txt output/
# Adaptive threshold mode (default)indexion segment --adaptive document.txt output/
# Hybrid NCD+TF-IDF modeindexion segment --hybrid --ncd-weight=0.6 --tfidf-weight=0.4 document.txt output/
# Custom window sizeindexion segment --window-size=5 document.txt output/
# Custom output prefixindexion segment --prefix=chunk document.txt output/

Options

Option	Default	Description
`--strategy=NAME`	window	Strategy: window, tfidf, punctuation
`--min-size=INT`	100	Minimum segment characters
`--max-size=INT`	2000	Maximum segment characters
`--target-size=INT`	500	Target segment characters
`--threshold=FLOAT`	0.42	Divergence threshold
`--window-size=INT`	3	Window size
`--adaptive`	true	Adaptive threshold mode
`--hybrid`	false	NCD+TF-IDF hybrid mode
`--ncd-weight=FLOAT`	0.5	NCD weight in hybrid mode
`--tfidf-weight=FLOAT`	0.5	TF-IDF weight in hybrid mode
`--prefix=NAME`	segment	Output file prefix

Strategies

Workflow

Run indexion segment <input-file> <output-dir> to split text with defaults
Adjust --threshold and --target-size to tune segmentation granularity
Use --hybrid mode for better accuracy on mixed-content documents

来源与署名

来源：trkbt10/indexion-skills位于skills/indexion-segment提交7ad5ad3

许可证：无许可证

内容归原作者所有。SourceWeft 从公开仓库中收录这些内容。

举报或申请下架

Strategy	Description
`window` (default)	Sliding window divergence detection
`tfidf`	TF-IDF based topic change detection
`punctuation`	Punctuation/sentence boundary based

Indexion Segment

indexion segment

When to Use

Usage

Options

Strategies

Workflow

来源与署名

更多来自 trkbt10/indexion-skills 的技能

Indexion Wiki

Indexion Sdd

Indexion Refactor

Indexion Kgf

Indexion Readme

Indexion Documentation

更多AI & Agents技能

Ppt Template Creator

Skill Development

Plugin Structure

Command Development

Claude Md Improver

Find Skills