Distilling Drifting Transformers with Representation Autoencoders

Benchmark Model Rank Results
image-generation-on-imagenet-256x256Drift-RAE (DiT DH-L)–FID: 1.82
image-generation-on-imagenet-256x256Drift-RAE (DiT DH-XL)–FID: 1.48