ResMLP: Feedforward networks for image classification with data-efficient training

Benchmark Model Rank Results
fine-grained-image-classification-on-oxfordResMLP-24#15Accuracy: 97.9%
fine-grained-image-classification-on-oxfordResMLP-12#18Accuracy: 97.4%
fine-grained-image-classification-on-stanfordResMLP-24#63Accuracy: 89.5%
fine-grained-image-classification-on-stanfordResMLP-12#65Accuracy: 84.6%
image-classification-on-cifar-100ResMLP-24#29Percentage correct: 89.5
image-classification-on-cifar-100ResMLP-12#47Percentage correct: 87.0
image-classification-on-flowers-102ResMLP24#30Accuracy: 97.9
image-classification-on-flowers-102ResMLP12#36Accuracy: 97.4
image-classification-on-imagenetResMLP-B24/8#399Top 1 Accuracy: 83.6%Number of params: 116M
image-classification-on-imagenetResMLP-S24#652Top 1 Accuracy: 80.8%Number of params: 30MGFLOPs: 6
image-classification-on-imagenetResMLP-36#704Top 1 Accuracy: 79.7%Number of params: 45M
image-classification-on-imagenetResMLP-24#718Top 1 Accuracy: 79.4%
image-classification-on-imagenetResMLP-12 (distilled, class-MLP)#774Top 1 Accuracy: 78.6%Number of params: 17.7MGFLOPs: 3
image-classification-on-imagenetResMLP-S12#813Top 1 Accuracy: 77.8%Number of params: 15.4M
image-classification-on-imagenet-realResMLP-36#41Accuracy: 85.6%Params: 45M
image-classification-on-imagenet-realResMLP-24#42Accuracy: 85.3%Params: 30M
image-classification-on-imagenet-realResMLP-12#44Accuracy: 84.6%Params: 15M
image-classification-on-imagenet-realResMLP-B24/8 (22k)#56Top 1 Accuracy: 84.4%
image-classification-on-imagenet-v2ResMLP-B24/8 22k#18Top 1 Accuracy: 74.2
image-classification-on-imagenet-v2ResMLP-B24/8#20Top 1 Accuracy: 73.4
image-classification-on-imagenet-v2ResMLP-S24/16#25Top 1 Accuracy: 69.8
image-classification-on-imagenet-v2ResMLP-S12/16#31Top 1 Accuracy: 66.0
image-classification-on-inaturalist-2018ResMLP-24#44Top-1 Accuracy: 64.3
image-classification-on-inaturalist-2018ResMLP-12#48Top-1 Accuracy: 60.2
image-classification-on-inaturalist-2019ResMLP-24#16Top-1 Accuracy: 72.5
image-classification-on-inaturalist-2019ResMLP-12#18Top-1 Accuracy: 71.0
image-classification-on-stanford-carsResMLP-24#14Accuracy: 89.5
image-classification-on-stanford-carsResMLP-12#19Accuracy: 84.6
machine-translation-on-wmt2014-english-frenchResMLP-12#29BLEU score: 40.6
machine-translation-on-wmt2014-english-frenchResMLP-6#33BLEU score: 40.3
machine-translation-on-wmt2014-english-germanResMLP-12#47BLEU score: 26.8
machine-translation-on-wmt2014-english-germanResMLP-6#51BLEU score: 26.4
self-supervised-image-classification-on-imagenetDINO (ResMLP-24)#86Top 1 Accuracy: 72.8%Number of Params: 30M
self-supervised-image-classification-on-imagenetDINO (ResMLP-12)#102Top 1 Accuracy: 67.5%Number of Params: 15M