Mcore Run On Slurm
by nvidiacf5224d14250Apache-2.03.5K starsListed Oct 8, 2026Updated Oct 8, 2026Repository updated today
How to launch distributed Megatron-LM training jobs on a SLURM cluster. Covers a minimal sbatch skeleton, environment-variable setup for torch.distributed.run, CUDA_DEVICE_MAX_CONNECTIONS rules across hardware and parallelism modes, container conventions, monitoring, and per-rank failure diagnosis.
- cf5224d14250Currentcommit cf5224dPublished Oct 8, 2026
Source and attribution
Source:nvidia/skillsinskills/mcore-run-on-slurmat commitcf5224d
License: Apache-2.0
Content belongs to its original authors. SourceWeft indexes it from a public repository.
More from nvidia/skills
Tilegym Cutile Python
nvidia
Guides writing, debugging and optimizing cuTile Python GPU kernels, with examples, validation loops and optional multi-agent orchestration.
Tilegym Monkey Patch Kernels To Transformers
nvidia
Integrates TileGym cuTile kernels into Hugging Face transformers models via non-intrusive monkey-patching and auto-generates new kernels.
Tilegym Converting Cutile To Julia
nvidia
Converts cuTile Python GPU kernels to cuTile.jl Julia equivalents, with rules, examples and a static validator.
Tilegym Adding Cutile Kernel
nvidia
Guides adding a new cuTile GPU kernel operator to TileGym, from dispatch registration through tests and benchmarks.
Physicsnemo Discover
nvidia
Guides discovery of PhysicsNeMo model families, datapipes and examples for a SciML task, citing live repo paths.
Nemoclaw User Guide
nvidia
Routes an AI agent to NemoClaw's canonical Markdown docs and docs MCP server to answer setup and operations questions.
More in DevOps & Cloud
Playwright Devops
microsoft
DevOps workflows for Playwright: analyze GitHub Actions failures for the last commit on main and fetch failed job logs.
M5 Onboard
anthropics
Provisions M5Stack ESP32 boards by detecting them on USB, flashing UIFlow 2.0 firmware, and installing a MicroPython app bundle.
Yeet
openai
Stages, commits, pushes, and opens or updates a GitHub pull request in one flow using the GitHub CLI.
Runbook
anthropics
Creates or updates step-by-step operational runbooks for recurring tasks, including troubleshooting, rollback and escalation.
Incident Response
anthropics
Guides an incident response workflow: severity triage, status updates, mitigation tracking, and blameless postmortems.
Deploy Checklist
anthropics
Generates a pre-deployment readiness checklist covering pre-deploy, deploy, post-deploy and rollback triggers.