CMuon: Accelerating and Stabilizing Diffusion Transformer Training via Chunked Momentum Orthogonalization

Benchmark Model Rank Results
image-generation-on-imagenet-256x256CMuon (DiT-XL)–FID: 1.18