LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference

Open paper

Benchmark	Model	Rank	Results
image-classification-on-cifar-10	LeViT-192	#50	Percentage correct: 98.2
image-classification-on-cifar-10	LeViT-256	#55	Percentage correct: 98.1
image-classification-on-cifar-10	LeViT-384	#59	Percentage correct: 98
image-classification-on-cifar-10	LeViT-128	#77	Percentage correct: 97.6
image-classification-on-cifar-10	LeViT-128S	#79	Percentage correct: 97.5
image-classification-on-flowers-102	LeViT-384	#24	Accuracy: 98.3
image-classification-on-flowers-102	LeViT-192	#34	Accuracy: 97.8
image-classification-on-flowers-102	LeViT-256	#35	Accuracy: 97.7
image-classification-on-flowers-102	LeViT-128S	#39	Accuracy: 96.8
image-classification-on-imagenet	LeViT-384	#514	Top 1 Accuracy: 82.5%Number of params: 39.4MGFLOPs: 2.334
image-classification-on-imagenet	LeViT-256	#600	Top 1 Accuracy: 81.6%Number of params: 17.8MGFLOPs: 1.066
image-classification-on-imagenet	LeViT-192	#688	Top 1 Accuracy: 80%Number of params: 10.4MGFLOPs: 0.624
image-classification-on-imagenet	LeViT-128	#707	Top 1 Accuracy: 79.6%Number of params: 8.8MGFLOPs: 0.376
image-classification-on-imagenet	LeViT-128S	#878	Top 1 Accuracy: 75.7%Number of params: 4.7MGFLOPs: 0.288
image-classification-on-imagenet-real	LeViT-384	#33	Accuracy: 87.5%
image-classification-on-imagenet-real	LeViT-256	#35	Accuracy: 86.9%
image-classification-on-imagenet-real	LeViT-192	#38	Accuracy: 85.8%
image-classification-on-imagenet-real	LeViT-128	#40	Accuracy: 85.6%
image-classification-on-imagenet-real	LeViT-128S	#47	Accuracy: 82.6%
image-classification-on-imagenet-v2	LeViT-384	#23	Top 1 Accuracy: 71.4
image-classification-on-imagenet-v2	LeViT-256	#24	Top 1 Accuracy: 69.9
image-classification-on-imagenet-v2	LeViT-192	#27	Top 1 Accuracy: 68.7
image-classification-on-imagenet-v2	LeViT-128	#29	Top 1 Accuracy: 67.5
image-classification-on-imagenet-v2	LeViT-128S	#33	Top 1 Accuracy: 63.9
image-classification-on-inaturalist-2018	LeViT-384	#39	Top-1 Accuracy: 66.9%
image-classification-on-inaturalist-2018	LeViT-256	#40	Top-1 Accuracy: 66.2%
image-classification-on-inaturalist-2018	LeViT-192	#46	Top-1 Accuracy: 60.4%
image-classification-on-inaturalist-2018	LeViT-128S	#49	Top-1 Accuracy: 55.2%
image-classification-on-inaturalist-2018	LeViT-128	#50	Top-1 Accuracy: 54%
image-classification-on-inaturalist-2019	LeViT-384	#14	Top-1 Accuracy: 74.3
image-classification-on-inaturalist-2019	LeViT-256	#17	Top-1 Accuracy: 72.3
image-classification-on-inaturalist-2019	LeViT-192	#19	Top-1 Accuracy: 70.8
image-classification-on-inaturalist-2019	LeViT-128	#20	Top-1 Accuracy: 68.4
image-classification-on-inaturalist-2019	LeViT-128S	#21	Top-1 Accuracy: 66.5
image-classification-on-stanford-cars	LeViT-192	#13	Accuracy: 89.8
image-classification-on-stanford-cars	LeViT-384	#15	Accuracy: 89.3
image-classification-on-stanford-cars	LeViT-128	#16	Accuracy: 88.6
image-classification-on-stanford-cars	LeViT-128S	#17	Accuracy: 88.4
image-classification-on-stanford-cars	LeViT-256	#18	Accuracy: 88.2