Nearest Neighbor Guidance for Out-of-Distribution Detection

Benchmark Model Rank Results
out-of-distribution-detection-on-imagenet-1k-1NNGuide-ViM (ViT-B/16)#1FPR95: 33.10AUROC: 92.96
out-of-distribution-detection-on-imagenet-1k-10NNGuide (ResNet50 w/ ReAct)#7AUROC: 96.11FPR95: 17.27Latency, ms: 11.10
out-of-distribution-detection-on-imagenet-1k-10NNGuide (RegNet)#8AUROC: 95.82FPR95: 17.00Latency, ms: 31.00
out-of-distribution-detection-on-imagenet-1k-11NNGuide (RegNet)#1AUROC: 97.73FPR95: 10.79Latency, ms: 31.00
out-of-distribution-detection-on-imagenet-1k-11NNGuide (ResNet50 w/ ReAct)#4AUROC: 92.49FPR95: 35.1Latency, ms: 11.10
out-of-distribution-detection-on-imagenet-1k-12NNGuide (RegNet)#1FPR95: 17.97AUROC: 95.42
out-of-distribution-detection-on-imagenet-1k-12NNGuide (ResNet50 w/ ReAct)#2FPR95: 19.72AUROC: 95.45
out-of-distribution-detection-on-imagenet-1k-3NNGuide (RegNet)#3AUROC: 99.57FPR95: 1.83Latency, ms: 31.00
out-of-distribution-detection-on-imagenet-1k-3NNGuide (ResNet50 w/ ReAct)#8AUROC: 97.7FPR95: 11.12Latency, ms: 11.10
out-of-distribution-detection-on-imagenet-1k-8NNGuide (RegNet)#3FPR95: 21.58AUROC: 94.43
out-of-distribution-detection-on-imagenet-1k-9NNGuide (RegNet)#3FPR95: 31.47AUROC: 91.87