Sparse MLP for Image Recognition: Is Self-Attention Really Necessary?

Benchmark Model Rank Results
image-classification-on-imagenetsMLPNet-B (ImageNet-1k)#414Top 1 Accuracy: 83.4%Number of params: 65.9M
image-classification-on-imagenetsMLPNet-S (ImageNet-1k)#452Top 1 Accuracy: 83.1%Number of params: 48.6M
image-classification-on-imagenetsMLPNet-T (ImageNet-1k)#576Top 1 Accuracy: 81.9%Number of params: 24.1M