iBOT: Image BERT Pre-Training with Online Tokenizer

Benchmark Model Rank Results
unsupervised-image-classification-on-imagenetiBOT (ViT-S/16)#3Accuracy (%): 43.4ARI: 32.8
self-supervised-image-classification-on-imagenet-finetunediBOT(ViT-L/16, 512)#8Top 1 Accuracy: 87.8%Number of Params: 307M
self-supervised-image-classification-on-imagenet-finetunediBOT(ViT-L/16)#12Top 1 Accuracy: 86.6%Number of Params: 307M
self-supervised-image-classification-on-imagenet-finetunediBOT (ViT-L/16)#26Top 1 Accuracy: 84.8%Number of Params: 307M
self-supervised-image-classification-on-imagenet-finetunediBOT (ViT-B/16)#31Top 1 Accuracy: 84.4%Number of Params: 85M
self-supervised-image-classification-on-imagenet-finetunediBOT (ViT-B/16)#38Top 1 Accuracy: 84.0%Number of Params: 85M
self-supervised-image-classification-on-imagenetiBOT (ViT-L/16) (IN22k)#11Top 1 Accuracy: 82.3%Number of Params: 307M
self-supervised-image-classification-on-imagenetiBOT (ViT-L/16)#16Top 1 Accuracy: 81.3%Number of Params: 307M
semi-supervised-image-classification-on-imagenet-1-labeled-dataiBOT (ViT-S/16)#32Top 1 Accuracy: 61.9%
instance-segmentation-on-coco-test-deviBOT (ViT-B/16)#44mask AP: 44.2
instance-segmentation-on-coco-test-deviBOT (ViT-S/16)#50mask AP: 42.6
object-detection-on-coco-test-deviBOT (ViT-B/16)#80box mAP: 51.2
object-detection-on-coco-test-deviBOT (ViT-S/16)#90box mAP: 49.4
semantic-segmentation-on-ade20kiBOT (ViT-B/16)#132Validation mIoU: 50.0
semantic-segmentation-on-ade20kiBOT (ViT-S/16)#204Validation mIoU: 45.4
semantic-segmentation-on-ade20kiBOT (ViT-B/16) (linear head)#238Validation mIoU: 38.3