Masked Siamese Networks for Label-Efficient Learning

Benchmark Model Rank Results
semi-supervised-image-classification-on-imagenet-1-labeled-dataMSN (ViT-B/4)#9Top 1 Accuracy: 75.7%
self-supervised-image-classification-on-imagenetMSN (ViT-L/7)#20Top 1 Accuracy: 80.7%Number of Params: 306M
image-classification-on-cifar-10MSN ViT-B/16#32Percentage correct: 99.0
image-classification-on-cifar-10MSN ViT-B/16 (linear probe)#151Percentage correct: 95.7
image-classification-on-cifar-100MSN ViT-B/16#36Percentage correct: 90.5
image-classification-on-cifar-100MSN ViT-B/16 (linear probe)#124Percentage correct: 82.8
image-classification-on-imagenetMSN ViT-B/16#461Top 1 Accuracy: 83.4%
image-classification-on-imagenetMSN ViT-L/7#724Top 1 Accuracy: 80.7%