In or Out? Fixing ImageNet Out-of-Distribution Detection Evaluation

Benchmark Model Rank Results
out-of-distribution-detection-on-imagenet-1k-13ViT-B-384 Mahalanobis (pre-trained on IN-21k)#2AUROC: 95.0FPR@95: 27.5
out-of-distribution-detection-on-imagenet-1k-13EffNetv2-M Relative Mahalanobis#3AUROC: 88.9FPR@95: 54.9
out-of-distribution-detection-on-imagenet-1k-13EffNetb7 Relative Cosine Sim#4AUROC: 87.9FPR@95: 53.7