Skip to content

Add option distributed_size to MegatronDistributedFusedAdam#12728

Closed
yuantailing wants to merge 2 commits intoNVIDIA:mainfrom
yuantailing:distributed_size
Closed

Add option distributed_size to MegatronDistributedFusedAdam#12728
yuantailing wants to merge 2 commits intoNVIDIA:mainfrom
yuantailing:distributed_size

Commits

Commits on Mar 21, 2025