Pre-training of Lightweight Vision Transformers on Small Datasets with Minimally Scaled Images
Open paper
Benchmark
Model
Rank
Results
image-classification-on-cifar-10
ViT (lightweight, MAE pretrained)
–
Percentage correct: 96.41
image-classification-on-cifar-100
ViT (lightweight, MAE pre-trained)
–
Percentage correct: 78.27
PARAMS: 3.64M
Rank counts only results with a code link.