FLAVA: A Foundational Language And Vision Alignment Model

Benchmark Model Rank Results
linear-probe-image-classification-on-sun397FLAVA#1Accuracy: 82.17
linear-probe-image-classification-on-caltech-101FLAVA#3Accuracy: 95.74
linear-probe-image-classification-on-dtdFLAVA#3Accuracy: 77.29
image-retrieval-on-cocoFLAVA (zero-shot)#4recall@1: 38.38recall@5: 67.47
image-retrieval-on-cocoCLIP (zero-shot)#5recall@1: 33.29recall@5: 62.47
linear-probe-image-classification-on-fgvc-aircraftFLAVA#4Accuracy: 47.31
linear-probe-image-classification-on-food-101FLAVA#5Accuracy: 88.51
image-to-text-retrieval-on-cocoFLAVA (ViT-B, zero-shot)#6Recall@1: 42.74Recall@5: 76.76
semantic-textual-similarity-on-sts-b-glue-devFLAVA#10Pearson/Spearman Correlation: 85.7
paraphrase-identification-on-mrpc-glue-devFLAVA#11F1: 86.9
linguistic-acceptability-on-cola-glue-devFLAVA#13Matthews Correlation: 50.7
natural-language-inference-on-rte-glue-devFLAVA#14Accuracy: 57.8
natural-language-inference-on-qnli-glue-devFLAVA#17Accuracy: 87.3
visual-question-answering-on-vqa-v2-test-devFLAVA#21Accuracy: 72.8
image-classification-on-flowers-102FLAVA#48Accuracy: 96.37
sentiment-analysis-on-sst-2-binary-classificationFLAVA#85Dev Accuracy: 90.9
image-classification-on-cifar-100FLAVA#175Percentage correct: 77.68
image-classification-on-cifar-10FLAVA#210Percentage correct: 92.87
image-classification-on-imagenetFLAVA#985Top 1 Accuracy: 75.54%