ResMLP: Feedforward networks for image classification with data-efficient training

Benchmark Model Rank Results
image-classification-on-stanford-carsResMLP-24#14Accuracy: 89.5
image-classification-on-stanford-carsResMLP-12#19Accuracy: 84.6
fine-grained-image-classification-on-oxford-102-flowersResMLP-24#15Accuracy: 97.9%
fine-grained-image-classification-on-oxford-102-flowersResMLP-12#18Accuracy: 97.4%
image-classification-on-inaturalist-2019ResMLP-24#16Top-1 Accuracy: 72.5
image-classification-on-inaturalist-2019ResMLP-12#18Top-1 Accuracy: 71.0
machine-translation-on-wmt2014-english-frenchResMLP-12#29BLEU score: 40.6
machine-translation-on-wmt2014-english-frenchResMLP-6#33BLEU score: 40.3
image-classification-on-imagenet-v2ResMLP-B24/8 22k#31Top 1 Accuracy: 74.2
image-classification-on-imagenet-v2ResMLP-B24/8#34Top 1 Accuracy: 73.4
image-classification-on-imagenet-v2ResMLP-S24/16#40Top 1 Accuracy: 69.8
image-classification-on-imagenet-v2ResMLP-S12/16#51Top 1 Accuracy: 66.0
image-classification-on-flowers-102ResMLP24#37Accuracy: 97.9
image-classification-on-flowers-102ResMLP12#44Accuracy: 97.4
image-classification-on-inaturalist-2018ResMLP-24#44Top-1 Accuracy: 64.3
image-classification-on-inaturalist-2018ResMLP-12#48Top-1 Accuracy: 60.2
image-classification-on-cifar-100ResMLP-24#47Percentage correct: 89.5
image-classification-on-cifar-100ResMLP-12#71Percentage correct: 87.0
image-classification-on-imagenet-realResMLP-36#47Accuracy: 85.6%Params: 45M
image-classification-on-imagenet-realResMLP-24#48Accuracy: 85.3%Params: 30M
image-classification-on-imagenet-realResMLP-12#50Accuracy: 84.6%Params: 15M
image-classification-on-imagenet-realResMLP-B24/8 (22k)#62Top 1 Accuracy: 84.4%
machine-translation-on-wmt2014-english-germanResMLP-12#48BLEU score: 26.8
machine-translation-on-wmt2014-english-germanResMLP-6#52BLEU score: 26.4
fine-grained-image-classification-on-stanford-carsResMLP-24#63Accuracy: 89.5%
fine-grained-image-classification-on-stanford-carsResMLP-12#65Accuracy: 84.6%
self-supervised-image-classification-on-imagenetDINO (ResMLP-24)#86Top 1 Accuracy: 72.8%Number of Params: 30M
self-supervised-image-classification-on-imagenetDINO (ResMLP-12)#102Top 1 Accuracy: 67.5%Number of Params: 15M
image-classification-on-imagenetResMLP-B24/8#441Top 1 Accuracy: 83.6%Number of params: 116M
image-classification-on-imagenetResMLP-S24#722Top 1 Accuracy: 80.8%Number of params: 30MGFLOPs: 6
image-classification-on-imagenetResMLP-36#781Top 1 Accuracy: 79.7%Number of params: 45M
image-classification-on-imagenetResMLP-24#797Top 1 Accuracy: 79.4%
image-classification-on-imagenetResMLP-12 (distilled, class-MLP)#859Top 1 Accuracy: 78.6%Number of params: 17.7MGFLOPs: 3
image-classification-on-imagenetResMLP-S12#901Top 1 Accuracy: 77.8%Number of params: 15.4M