A framework for benchmarking class-out-of-distribution detection and its application to ImageNet

Benchmark Model Rank Results
classification-on-imagenet-c-ood-class-out-of-distributionViT-L/32-384 with Max-logit#1Detection AUROC (severity 0): 0.9958Detection AUROC (severity 5): 0.9632…
classification-on-imagenet-c-ood-class-out-of-distributionViT-L/32-384 with ODIN#2Detection AUROC (severity 0): 0.9955Detection AUROC (severity 5): 0.9589…
classification-on-imagenet-c-ood-class-out-of-distributionViT-L/32-384 with Entropy#3Detection AUROC (severity 0): 0.9948Detection AUROC (severity 5): 0.9514…
classification-on-imagenet-c-ood-class-out-of-distributionViT-L/32-384 with MC Dropout#4Detection AUROC (severity 0): 0.9947Detection AUROC (severity 5): 0.9478…
classification-on-imagenet-c-ood-class-out-of-distributionViT-L/32-384 with Softmax#5Detection AUROC (severity 0): 0.9915Detection AUROC (severity 5): 0.9293…