In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluation

Benchmark Model Rank Results
out-of-distribution-detection-on-imagenet-1k-vs-nincoViT-B-384 Mahalanobis (pre-trained on IN-21k)#2AUROC: 95.0FPR@95: 27.5
out-of-distribution-detection-on-imagenet-1k-vs-nincoEffNetv2-M Relative Mahalanobis#3AUROC: 88.9FPR@95: 54.9
out-of-distribution-detection-on-imagenet-1k-vs-nincoEffNetb7 Relative Cosine Sim#4AUROC: 87.9FPR@95: 53.7