Enhanced OoD Detection through Cross-Modal Alignment of Multi-Modal Representations

Benchmark Model Rank Results
out-of-distribution-detection-on-imagenet-1k-vs-placesCMA(ViT-B/16, NegLabel)#1FPR95: 27.65AUROC: 93.11
out-of-distribution-detection-on-imagenet-1k-vs-sunCMA(ViT-B/16, NegLabel)#1FPR95: 16.84AUROC: 96.36
out-of-distribution-detection-on-imagenet-1k-vs-inaturalistCMA(ViT-B/16, NegLabel)#2AUROC: 99.62FPR95: 1.65
out-of-distribution-detection-on-imagenet-1k-vs-texturesCMA(ViT-B/16, NegLabel)#14AUROC: 91.64FPR95: 33.58
image-classification-on-imagenetCMA(ViT-B/16)#549Top 1 Accuracy: 82.64%