DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets

Benchmark Model Rank Results
image-classification-on-inaturalistb_22DeiT-LT(ours)#19Overall: 75.1
long-tail-learning-on-cifar-10-lt-r-100DeiT-LT#5Error Rate: 12.5
long-tail-learning-on-cifar-10-lt-r-50DeiT-LT#3Error Rate: 10.2
long-tail-learning-on-cifar-100-lt-r-100DeiT-LT#11Error Rate: 44.4
long-tail-learning-on-cifar-100-lt-r-50DeiT-LT#8Error Rate: 39.5
long-tail-learning-on-imagenet-ltDeiT-LT#15Top-1 Accuracy: 59.1
long-tail-learning-on-inaturalist-2018DeiT-LT#14Top-1 Accuracy: 75.1%