Mcore Run On Slurm

by nvidiacf5224d14250Apache-2.03.5K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated today

How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.

Instructions onlyDevOps & Cloud

Only the file list is public. File contents are available once the skill is installed in a workspace.

PathSizeType
BENCHMARK.md2.7 KBtext/markdown
evals/evals.json3 Bapplication/json
skill-card.md2.8 KBtext/markdown
SKILL.md7.1 KBtext/markdown
skill.oms.sig4.5 KBtext/plain

Source and attribution

Source:nvidia/skillsinskills/mcore-run-on-slurmat commitcf5224d

License: Apache-2.0

Content belongs to its original authors. SourceWeft indexes it from a public repository.

Report or request removal