CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization
Open paper
Benchmark
Model
Rank
Results
image-generation-on-imagenet-256x256
CMuon (DiT-XL)
–
FID: 1.18
Rank counts only results with a code link.