Align before Fuse: Vision and Language Representation Learning with Momentum Distillation

Benchmark Model Rank Results
open-vocabulary-attribute-detection-on-ovad-boxALBEF#5mean average precision: 21.0
image-text-matching-on-commercialadsdatasetALBEF#6ADD(S) AUC: 82.74
image-to-text-retrieval-on-flickr30kALBEF#7Recall@1: 95.9Recall@5: 99.8Recall@10: 100.0
visual-reasoning-on-nlvr2-devALBEF (14M)#11Accuracy: 83.14
visual-reasoning-on-nlvr2-testALBEF (14M)#12Accuracy: 82.55
zero-shot-cross-modal-retrieval-on-flickr30kALBEF#12Image-to-text R@1: 90.5Image-to-text R@5: 98.8…
cross-modal-retrieval-on-coco-2014ALBEF#13Text-to-image R@1: 60.7Text-to-image R@5: 84.3…
zero-shot-cross-modal-retrieval-on-coco-2014ALBEF#14Image-to-text R@1: 68.7Image-to-text R@5: 89.5…
visual-question-answering-on-vqa-v2-test-stdALBEF (14M)#16overall: 76.04
visual-question-answering-on-vqa-v2-test-devALBEF (14M)#18Accuracy: 75.84