Exploring Target Representations for Masked Autoencoders

Benchmark Model Rank Results
self-supervised-image-classification-on-imagenet-finetuneddBOT (ViT-H/14)#6Top 1 Accuracy: 88.0%Number of Params: 632M
instance-segmentation-on-coco-test-devdBOT ViT-L (CLIP)#26mask AP: 48.8
instance-segmentation-on-coco-test-devdBOT ViT-L#29mask AP: 48.3
instance-segmentation-on-coco-test-devdBOT ViT-B#36mask AP: 46.3
instance-segmentation-on-coco-test-devdBOT ViT-B (CLIP)#37mask AP: 46.2
object-detection-on-coco-test-devdBOT ViT-L (CLIP)#36box mAP: 56.8
object-detection-on-coco-test-devdBOT ViT-L#41box mAP: 56.1
object-detection-on-coco-test-devdBOT ViT-B#60box mAP: 53.5
semantic-segmentation-on-ade20kdBOT ViT-L (CLIP)#43Validation mIoU: 56.2
semantic-segmentation-on-ade20kdBOT ViT-L#50Validation mIoU: 55.2
semantic-segmentation-on-ade20kdBOT ViT-B (CLIP)#89Validation mIoU: 52.9
semantic-segmentation-on-ade20kdBOT ViT-B#119Validation mIoU: 50.8
image-classification-on-imagenetdBOT ViT-H (CLIP as Teacher)#62Top 1 Accuracy: 88.2%
image-classification-on-imagenetdBOT ViT-L (CLIP as Teacher)#77Top 1 Accuracy: 87.8%
image-classification-on-imagenetdBOT ViT-B (CLIP as Teacher)#221Top 1 Accuracy: 85.7%
object-detection-on-coco-val2017dBOT (ViT-B, CLIP teacher, Mask R-CNN)#140box AP: 53.6