CvT: Introducing Convolutions to Vision Transformers

Open paper
Benchmark Model Rank Results
image-classification-on-oxford-iiit-pets-1CvT-W24#2Accuracy: 94.73
image-classification-on-flowers-102CvT-W24#3Accuracy: 99.72
image-classification-on-cifar-10CvT-W24#7Percentage correct: 99.39
image-classification-on-cifar-100CvT-W24#8Percentage correct: 94.09
image-classification-on-imagenet-realCvT-W24 (384 res, ImageNet-22k pretrain)#17Accuracy: 90.6%Top 1 Accuracy: 87.7%Number of params: 277M
image-classification-on-imagenet-v2CvT-W24 384#19Top 1 Accuracy: 78.8
image-classification-on-imagenetCvT-W24 (384 res, ImageNet-22k pretrain)#80Top 1 Accuracy: 87.7%
image-classification-on-imagenetCvT-21 (384 res, ImageNet-22k pretrain)#293Top 1 Accuracy: 84.9%Number of params: 32MGFLOPs: 25
image-classification-on-imagenetCvT-21 (384 res)#470Top 1 Accuracy: 83.3%GFLOPs: 24.9
image-classification-on-imagenetCvT-13 (384 res)#507Top 1 Accuracy: 83%Number of params: 20MGFLOPs: 16.3
image-classification-on-imagenetCvT-21#563Top 1 Accuracy: 82.5%GFLOPs: 7.1
image-classification-on-imagenetCvT-13-NAS#600Top 1 Accuracy: 82.2%Number of params: 18MGFLOPs: 4.1
image-classification-on-imagenetCvT-13#657Top 1 Accuracy: 81.6%GFLOPs: 4.5

Rank counts only results with a code link.