Skill

training-llms-megatron

Published by Orchestra Research

Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies. Use when training models >1B parameters, need maximum GPU efficiency (47% MFU on H100), or require tensor/pipeline/sequence/context/expert parallelism. Production-ready framework used f

Open official page Repository

Skill details

Resource Id
0b6b1800-4c25-4abd-9176-5c8082e9ae0f
Skill Md Url
https://github.com/davila7/claude-code-templates/blob/14680ec431ec8cbfd42b12ddcbe58e2f4ee3cccf/cli-tool/components/skills/ai-research/distributed-training-megatron-core/SKILL.md
Supported Agents
Claude Code
Version
1.0.0
Created At
"2026-10-08T13:50:29.408Z"
Updated At
"2026-10-08T13:50:29.408Z"