Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN

Benchmark Model Rank Results
self-supervised-image-classification-on-imagenet-finetunedA2MIM+ (ViT-B)#30Top 1 Accuracy: 84.5%
self-supervised-image-classification-on-imagenet-finetunedA2MIM (ViT-B)#34Top 1 Accuracy: 84.2%
self-supervised-image-classification-on-imagenet-finetunedA2MIM+ (ViT-S)#51Top 1 Accuracy: 82.4%
self-supervised-image-classification-on-imagenet-finetunedA2MIM (ViT-S)#52Top 1 Accuracy: 82.2%
self-supervised-image-classification-on-imagenet-finetunedA2MIM+ (ResNet-50 RSB-A2)#56Top 1 Accuracy: 80.5%
self-supervised-image-classification-on-imagenet-finetunedA2MIM (ResNet-50 RSB-A2)#57Top 1 Accuracy: 80.4%
self-supervised-image-classification-on-imagenet-finetunedA2MIM+ (ResNet-50 RSB-A3)#58Top 1 Accuracy: 78.9%
self-supervised-image-classification-on-imagenet-finetunedA2MIM (ResNet-50 RSB-A3)#59Top 1 Accuracy: 78.8%
instance-segmentation-on-coco-test-devA2MIM (ViT-B)#46mask AP: 43.5
instance-segmentation-on-coco-test-devA2MIM (ResNet-50 2x)#95mask AP: 34.9
semantic-segmentation-on-ade20kA2MIM (ViT-B)#154Validation mIoU: 49
semantic-segmentation-on-ade20kA2MIM (ResNet-50)#239Validation mIoU: 38.3
object-detection-on-coco-val2017A2MIM (ViT-B, Mask R-CNN)#230box AP: 49.4
object-detection-on-coco-val2017A2MIM (ResNet-50-C4, Mask R-CNN 2x)#404box AP: 39.8