Parallel Agents

by parcadeid07ff4b06b62No license3.9K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated 8 months ago

Parallel Agent Orchestration

Instructions onlyAI & Agents
AI-generated overview

Patterns for launching multiple subagents in parallel while avoiding context bloat through file-based status tracking.

What it does
This skill documents an orchestration pattern for running several agents concurrently in the background and having each one confirm completion by appending a line to a shared status file instead of returning output. It also describes a directory layout for detailed agent findings and commands for monitoring batch progress.
When to use it
Use it when a task can be split into many independent subtasks that should run at the same time, such as batch backfills or parallel research. It is meant for coordinating up to fifteen agents per batch without flooding the main context with their output.
Requirements
Requires an agent runtime that supports background subagent tasks and shell access for writing and reading status files; no scripts or packages are included.

Parallel Agent Orchestration

When launching multiple agents in parallel, follow this pattern to avoid context bloat.

Core Principles

  1. No TaskOutput calls - TaskOutput returns full agent output, bloating context
  2. Run in background - Always use run_in_background: true
  3. File-based confirmation - Agents write status to files, not return values
  4. Append, don't overwrite - Multiple agents can write to same status file

Output Patterns

Simple Confirmation (parallel batch work)

For tasks where agents just need to confirm completion:

bash
# Agent writes to shared status fileecho "COMPLETE: <task-name> - $(date)" >> .claude/cache/<batch-name>-status.txt
  • Use >> to append (not > which overwrites)
  • Include timestamp for ordering
  • One line per agent completion
  • Check with: cat .claude/cache/<batch-name>-status.txt

Detailed Output (research/exploration)

For tasks requiring detailed findings:

.claude/cache/agents/<task-type>/<agent-id>/├── output.md      # Main findings├── artifacts/     # Any generated files└── status.txt     # Completion confirmation
  • Each agent gets own directory
  • Full output preserved for later reading
  • Status file still used for quick completion check

Task Prompt Template

markdown
# Task: <TASK_NAME>
## Your Mission<clear objective>
## OutputWhen done, write confirmation:\`\`\`bashecho "COMPLETE: <identifier> - $(date)" >> .claude/cache/<batch>-status.txt\`\`\`
Do NOT return large output. Complete work silently.

Launching Pattern

typescript
// Launch all in single message block (parallel)Task({  description: "Task 1",  prompt: "...",  subagent_type: "general-purpose",  run_in_background: true})Task({  description: "Task 2",  prompt: "...",  subagent_type: "general-purpose",  run_in_background: true})// ... up to 15 parallel agents

Monitoring

bash
# Check completion statuscat .claude/cache/<batch>-status.txt
# Count completionswc -l .claude/cache/<batch>-status.txt
# Watch for updatestail -f .claude/cache/<batch>-status.txt

Batch Size

  • Max 15 agents per parallel batch
  • Wait for batch to complete before launching next
  • Use status file to track which completed

DO

  • Use run_in_background: true always
  • Have agents write to status files
  • Use append (>>) not overwrite (>)
  • Give each agent clear, self-contained instructions
  • Include all context in prompt (agents don't share memory)

DON'T

  • Call TaskOutput (bloats context)
  • Return large outputs from agents
  • Launch more than 15 at once
  • Rely on agent return values for orchestration

Example: Provider Backfill

bash
# Status file.claude/cache/provider-backfill-status.txt
# Each agent appends on completionecho "COMPLETE: anthropic - Thu Jan 2 12:34:56 2025" >> .claude/cache/provider-backfill-status.txtecho "COMPLETE: openai - Thu Jan 2 12:35:12 2025" >> .claude/cache/provider-backfill-status.txt

Check progress:

bash
cat .claude/cache/provider-backfill-status.txt# COMPLETE: anthropic - Thu Jan 2 12:34:56 2025# COMPLETE: openai - Thu Jan 2 12:35:12 2025

Source and attribution

Source:parcadei/continuous-claude-v3in.claude/skills/parallel-agentsat commitd07ff4b

License: No license

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal