Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think

Benchmark Model Rank Results
image-generation-on-imagenet-256x256SiT-XL/2 + REPA (with the guidance interval)#29FID: 1.42
image-generation-on-imagenet-512x512SiT-XL/2 + REPA (200 epochs, w=1.35) (extra data)#40FID: 2.08Inception score: 274.6