Add option distributed_size to MegatronDistributedFusedAdam#12728
Closed
yuantailing wants to merge 2 commits intoNVIDIA:mainfrom
Closed
Add option distributed_size to MegatronDistributedFusedAdam#12728yuantailing wants to merge 2 commits intoNVIDIA:mainfrom
yuantailing wants to merge 2 commits intoNVIDIA:mainfrom