When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations

Benchmark Model Rank Results
fine-grained-image-classification-on-oxford-iiit-petsResNet-152-SAM#10Accuracy: 93.3
fine-grained-image-classification-on-oxford-iiit-petsViT-B/16- SAM#11Accuracy: 93.1
fine-grained-image-classification-on-oxford-iiit-petsViT-S/16- SAM#12Accuracy: 92.9
fine-grained-image-classification-on-oxford-iiit-petsMixer-B/16- SAM#13Accuracy: 92.5
fine-grained-image-classification-on-oxford-iiit-petsResNet-50-SAM#14Accuracy: 91.6
fine-grained-image-classification-on-oxford-iiit-petsMixer-S/16- SAM#15Accuracy: 88.7
domain-generalization-on-imagenet-rResNet-152x2-SAM#36Top-1 Error Rate: 71.9
domain-generalization-on-imagenet-rViT-B/16-SAM#37Top-1 Error Rate: 73.6
domain-generalization-on-imagenet-rMixer-B/8-SAM#38Top-1 Error Rate: 76.5
image-classification-on-imagenet-v2ResNet-152x2-SAM#42Top 1 Accuracy: 69.6
image-classification-on-imagenet-v2ViT-B/16-SAM#49Top 1 Accuracy: 67.5
image-classification-on-imagenet-v2Mixer-B/8-SAM#52Top 1 Accuracy: 65.5
image-classification-on-imagenet-realResNet-152x2-SAM#43Accuracy: 86.4%
image-classification-on-imagenet-realViT-B/16-SAM#49Accuracy: 85.2%
image-classification-on-imagenet-realMixer-B/8-SAM#51Accuracy: 84.4%
domain-generalization-on-imagenet-cViT-B/16-SAM#44Top 1 Accuracy: 56.5
domain-generalization-on-imagenet-cResNet-152x2-SAM#45Top 1 Accuracy: 55
domain-generalization-on-imagenet-cMixer-B/8-SAM#47Top 1 Accuracy: 48.9
image-classification-on-cifar-10ViT-B/16- SAM#47Percentage correct: 98.6
image-classification-on-cifar-10ResNet-152-SAM#66Percentage correct: 98.2
image-classification-on-cifar-10ViT-S/16- SAM#67Percentage correct: 98.2
image-classification-on-cifar-10Mixer-B/16- SAM#90Percentage correct: 97.8
image-classification-on-cifar-10ResNet-50-SAM#108Percentage correct: 97.4
image-classification-on-cifar-10Mixer-S/16- SAM#143Percentage correct: 96.1
image-classification-on-flowers-102ViT-B/16- SAM#54Accuracy: 91.8
image-classification-on-flowers-102ViT-S/16- SAM#55Accuracy: 91.5
image-classification-on-flowers-102ResNet-152-SAM#56Accuracy: 91.1
image-classification-on-flowers-102ResNet-50-SAM#57Accuracy: 90
image-classification-on-flowers-102Mixer-B/16- SAM#58Accuracy: 90
image-classification-on-flowers-102Mixer-S/16- SAM#60Accuracy: 87.9
image-classification-on-cifar-100ViT-B/16- SAM#55Percentage correct: 89.1
image-classification-on-cifar-100ViT-S/16- SAM#66Percentage correct: 87.6
image-classification-on-cifar-100Mixer-B/16- SAM#77Percentage correct: 86.4
image-classification-on-cifar-100ResNet-50-SAM#91Percentage correct: 85.2
image-classification-on-cifar-100Mixer-S/16- SAM#133Percentage correct: 82.4
image-classification-on-imagenetResNet-152x2-SAM#702Top 1 Accuracy: 81.1%Number of params: 236M
image-classification-on-imagenetViT-B/16-SAM#768Top 1 Accuracy: 79.9%Number of params: 87M
image-classification-on-imagenetMixer-B/8-SAM#831Top 1 Accuracy: 79%Number of params: 64M