Spatial-Channel Token Distillation for Vision MLPs

Benchmark Model Rank Results
image-classification-on-imagenetResMLP-B24 + STD#524Top 1 Accuracy: 82.4%Number of params: 122.6MGFLOPs: 24.1
image-classification-on-imagenetCycleMLP-B2 + STD#559Top 1 Accuracy: 82.1%Number of params: 30.1MGFLOPs: 4.0
image-classification-on-imagenetMixer-S16 + STD#879Top 1 Accuracy: 75.7%Number of params: 22.2MGFLOPs: 4.3