Vision Transformer Adapter for Dense Predictions

Benchmark Model Rank Results
semantic-segmentation-on-pascal-contextViT-Adapter-L (Mask2Former, BEiT pretrain)#3mIoU: 68.2
semantic-segmentation-on-pascal-contextViT-Adapter-L (UperNet, BEiT pretrain)#4mIoU: 67.5
semantic-segmentation-on-cityscapes-testViT-Adapter-L (Mask2Former, BEiT pretrain)#5Mean IoU (class): 85.2%
instance-segmentation-on-coco-minivalViT-Adapter-L (HTC++, BEiTv2, O365, multi-scale)#7mask AP: 54.2
instance-segmentation-on-coco-minivalViT-Adapter-L (HTC++, BEiTv2 pretrain, multi-scale)#14mask AP: 52.5
instance-segmentation-on-coco-minivalViT-Adapter-L (HTC++, BEiT pretrain, multi-scale)#15mask AP: 52.2
instance-segmentation-on-coco-test-devViT-Adapter-L (HTC++, BEiTv2, O365, multi-scale)#7mask AP: 54.5
instance-segmentation-on-coco-test-devViT-Adapter-L (HTC++, BEiTv2 pretrain, multi-scale)#12mask AP: 53.0
instance-segmentation-on-coco-test-devViT-Adapter-L (HTC++, BEiT pretrain, multi-scale)#14mask AP: 52.5
semantic-segmentation-on-ade20k-valViT-Adapter-L (Mask2Former, BEiT pretrain)#7mIoU: 60.5
semantic-segmentation-on-ade20k-valViT-Adapter-L (UperNet, BEiT pretrain)#10mIoU: 58.4
semantic-segmentation-on-ade20kViT-Adapter-L (Mask2Former, BEiTv2 pretrain)#9Validation mIoU: 61.5Params (M): 571
semantic-segmentation-on-ade20kViT-Adapter-L (Mask2Former, BEiT pretrain)#13Validation mIoU: 60.5Params (M): 571
semantic-segmentation-on-ade20kViT-Adapter-L (UperNet, BEiT pretrain)#22Validation mIoU: 58.4Params (M): 451
semantic-segmentation-on-cityscapes-valViT-Adapter-L#9mIoU: 85.8
panoptic-segmentation-on-coco-minivalViT-Adapter-L (single-scale, BEiTv2 pretrain, Mask2Former)#10PQ: 58.4PQst: 48.4PQth: 65.0AP: 48.9
object-detection-on-coco-oViT-Adapter (BEiTv2-L)#11Average mAP: 34.25Effective Robustness: 7.79
object-detection-on-coco-test-devViT-Adapter-L (HTC++, BEiTv2 pretrain, multi-scale)#23box mAP: 60.9
object-detection-on-coco-test-devViT-Adapter-L (HTC++, BEiT pretrain, multi-scale)#26box mAP: 60.4
object-detection-on-coco-val2017ViT-Adapter-L (HTC++, BEiTv2 pretrain, multi-scale)#25box AP: 60.5
object-detection-on-coco-val2017ViT-Adapter-L (HTC++, BEiT pretrain, multi-scale)#29box AP: 60.2