Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet

Open paper
Benchmark Model Rank Results
image-classification-on-imagenetT2T-ViT-14|384#468Top 1 Accuracy: 83.3%GFLOPs: 34.2
image-classification-on-imagenetT2T-ViTt-24#554Top 1 Accuracy: 82.6%Number of params: 64.4MGFLOPs: 30
image-classification-on-imagenetT2T-ViT-24#583Top 1 Accuracy: 82.3%GFLOPs: 27.6
image-classification-on-imagenetT2T-ViTt-19#596Top 1 Accuracy: 82.2%Number of params: 39.2MGFLOPs: 19.6
image-classification-on-imagenetT2T-ViT-19#627Top 1 Accuracy: 81.9%GFLOPs: 17.0
image-classification-on-imagenetT2T-ViT-14#667Top 1 Accuracy: 81.5%Number of params: 21.5MGFLOPs: 9.6

Rank counts only results with a code link.