MEGATRON CORE
Megatron Core
NVIDIA Megatron Core Gets Dynamic-CP Update With 48% Training Speedups
NVIDIA releases Dynamic Context Parallelism for Megatron Core, achieving up to 1.48x faster LLM training and 35% gains in industrial deployments.
Megatron Core
NVIDIA Enhances Training Throughput with NeMo-RL's Megatron-Core
NVIDIA introduces Megatron-Core support in NeMo-RL v0.3, optimizing training throughput for large models with GPU-optimized techniques and enhanced parallelism.