When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations

Benchmark Model Rank Results
domain-generalization-on-imagenet-cViT-B/16-SAM#44Top 1 Accuracy: 56.5
domain-generalization-on-imagenet-cResNet-152x2-SAM#45Top 1 Accuracy: 55
domain-generalization-on-imagenet-cMixer-B/8-SAM#47Top 1 Accuracy: 48.9
domain-generalization-on-imagenet-rResNet-152x2-SAM#36Top-1 Error Rate: 71.9
domain-generalization-on-imagenet-rViT-B/16-SAM#37Top-1 Error Rate: 73.6
domain-generalization-on-imagenet-rMixer-B/8-SAM#38Top-1 Error Rate: 76.5
fine-grained-image-classification-on-oxford-2ResNet-152-SAM#10Accuracy: 93.3
fine-grained-image-classification-on-oxford-2ViT-B/16- SAM#11Accuracy: 93.1
fine-grained-image-classification-on-oxford-2ViT-S/16- SAM#12Accuracy: 92.9
fine-grained-image-classification-on-oxford-2Mixer-B/16- SAM#13Accuracy: 92.5
fine-grained-image-classification-on-oxford-2ResNet-50-SAM#14Accuracy: 91.6
fine-grained-image-classification-on-oxford-2Mixer-S/16- SAM#15Accuracy: 88.7
image-classification-on-cifar-10ViT-B/16- SAM#35Percentage correct: 98.6
image-classification-on-cifar-10ResNet-152-SAM#51Percentage correct: 98.2
image-classification-on-cifar-10ViT-S/16- SAM#52Percentage correct: 98.2
image-classification-on-cifar-10Mixer-B/16- SAM#70Percentage correct: 97.8
image-classification-on-cifar-10ResNet-50-SAM#86Percentage correct: 97.4
image-classification-on-cifar-10Mixer-S/16- SAM#117Percentage correct: 96.1
image-classification-on-cifar-100ViT-B/16- SAM#33Percentage correct: 89.1
image-classification-on-cifar-100ViT-S/16- SAM#42Percentage correct: 87.6
image-classification-on-cifar-100Mixer-B/16- SAM#53Percentage correct: 86.4
image-classification-on-cifar-100ResNet-50-SAM#63Percentage correct: 85.2
image-classification-on-cifar-100Mixer-S/16- SAM#101Percentage correct: 82.4
image-classification-on-flowers-102ViT-B/16- SAM#42Accuracy: 91.8
image-classification-on-flowers-102ViT-S/16- SAM#43Accuracy: 91.5
image-classification-on-flowers-102ResNet-152-SAM#44Accuracy: 91.1
image-classification-on-flowers-102ResNet-50-SAM#45Accuracy: 90
image-classification-on-flowers-102Mixer-B/16- SAM#46Accuracy: 90
image-classification-on-flowers-102Mixer-S/16- SAM#48Accuracy: 87.9
image-classification-on-imagenetResNet-152x2-SAM#634Top 1 Accuracy: 81.1%Number of params: 236M
image-classification-on-imagenetViT-B/16-SAM#692Top 1 Accuracy: 79.9%Number of params: 87M
image-classification-on-imagenetMixer-B/8-SAM#750Top 1 Accuracy: 79%Number of params: 64M
image-classification-on-imagenet-realResNet-152x2-SAM#37Accuracy: 86.4%
image-classification-on-imagenet-realViT-B/16-SAM#43Accuracy: 85.2%
image-classification-on-imagenet-realMixer-B/8-SAM#45Accuracy: 84.4%
image-classification-on-imagenet-v2ResNet-152x2-SAM#26Top 1 Accuracy: 69.6
image-classification-on-imagenet-v2ViT-B/16-SAM#30Top 1 Accuracy: 67.5
image-classification-on-imagenet-v2Mixer-B/8-SAM#32Top 1 Accuracy: 65.5