LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference

Open paper

Benchmark	Model	Rank	Results
image-classification-on-stanford-cars	LeViT-192	#13	Accuracy: 89.8
image-classification-on-stanford-cars	LeViT-384	#15	Accuracy: 89.3
image-classification-on-stanford-cars	LeViT-128	#16	Accuracy: 88.6
image-classification-on-stanford-cars	LeViT-128S	#17	Accuracy: 88.4
image-classification-on-stanford-cars	LeViT-256	#18	Accuracy: 88.2
image-classification-on-inaturalist-2019	LeViT-384	#14	Top-1 Accuracy: 74.3
image-classification-on-inaturalist-2019	LeViT-256	#17	Top-1 Accuracy: 72.3
image-classification-on-inaturalist-2019	LeViT-192	#19	Top-1 Accuracy: 70.8
image-classification-on-inaturalist-2019	LeViT-128	#20	Top-1 Accuracy: 68.4
image-classification-on-inaturalist-2019	LeViT-128S	#21	Top-1 Accuracy: 66.5
image-classification-on-flowers-102	LeViT-384	#31	Accuracy: 98.3
image-classification-on-flowers-102	LeViT-192	#41	Accuracy: 97.8
image-classification-on-flowers-102	LeViT-256	#43	Accuracy: 97.7
image-classification-on-flowers-102	LeViT-128S	#47	Accuracy: 96.8
image-classification-on-imagenet-v2	LeViT-384	#37	Top 1 Accuracy: 71.4
image-classification-on-imagenet-v2	LeViT-256	#39	Top 1 Accuracy: 69.9
image-classification-on-imagenet-v2	LeViT-192	#45	Top 1 Accuracy: 68.7
image-classification-on-imagenet-v2	LeViT-128	#48	Top 1 Accuracy: 67.5
image-classification-on-imagenet-v2	LeViT-128S	#53	Top 1 Accuracy: 63.9
image-classification-on-imagenet-real	LeViT-384	#39	Accuracy: 87.5%
image-classification-on-imagenet-real	LeViT-256	#41	Accuracy: 86.9%
image-classification-on-imagenet-real	LeViT-192	#44	Accuracy: 85.8%
image-classification-on-imagenet-real	LeViT-128	#46	Accuracy: 85.6%
image-classification-on-imagenet-real	LeViT-128S	#53	Accuracy: 82.6%
image-classification-on-inaturalist-2018	LeViT-384	#39	Top-1 Accuracy: 66.9%
image-classification-on-inaturalist-2018	LeViT-256	#40	Top-1 Accuracy: 66.2%
image-classification-on-inaturalist-2018	LeViT-192	#46	Top-1 Accuracy: 60.4%
image-classification-on-inaturalist-2018	LeViT-128S	#49	Top-1 Accuracy: 55.2%
image-classification-on-inaturalist-2018	LeViT-128	#50	Top-1 Accuracy: 54%
image-classification-on-cifar-10	LeViT-192	#65	Percentage correct: 98.2
image-classification-on-cifar-10	LeViT-256	#73	Percentage correct: 98.1
image-classification-on-cifar-10	LeViT-384	#79	Percentage correct: 98
image-classification-on-cifar-10	LeViT-128	#99	Percentage correct: 97.6
image-classification-on-cifar-10	LeViT-128S	#101	Percentage correct: 97.5
image-classification-on-imagenet	LeViT-384	#564	Top 1 Accuracy: 82.5%Number of params: 39.4MGFLOPs: 2.334
image-classification-on-imagenet	LeViT-256	#658	Top 1 Accuracy: 81.6%Number of params: 17.8MGFLOPs: 1.066
image-classification-on-imagenet	LeViT-192	#763	Top 1 Accuracy: 80%Number of params: 10.4MGFLOPs: 0.624
image-classification-on-imagenet	LeViT-128	#786	Top 1 Accuracy: 79.6%Number of params: 8.8MGFLOPs: 0.376
image-classification-on-imagenet	LeViT-128S	#977	Top 1 Accuracy: 75.7%Number of params: 4.7MGFLOPs: 0.288