Skip to content

Count each expert once in the fp32 gradient-clipping norm - #8478

Open
alanhuangyoo wants to merge 8 commits into
deepspeedai:masterfrom
alanhuangyoo:fix/fp32-clip-moe-norm
Open

Count each expert once in the fp32 gradient-clipping norm#8478
alanhuangyoo wants to merge 8 commits into
deepspeedai:masterfrom
alanhuangyoo:fix/fp32-clip-moe-norm

Merge branch 'master' into fix/fp32-clip-moe-norm

5d2f605
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 26, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO