Measuring Robustness to Natural Distribution Shifts in Image Classification

Benchmark Model Rank Results
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C)#41Accuracy - All Images: 38.8Accuracy - Corrupted Images: 33.6…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_brightness)#42Accuracy - All Images: 38.8Accuracy - Corrupted Images: 32.5…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_spatter)#48Accuracy - All Images: 38.3Accuracy - Corrupted Images: 31.4…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_saturate)#50Accuracy - All Images: 38.2Accuracy - Corrupted Images: 32.4…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_pixelate)#52Accuracy - All Images: 37.4Accuracy - Corrupted Images: 30.9…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_contrast)#59Accuracy - All Images: 36.5Accuracy - Corrupted Images: 30.7…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_jpeg_compression)#60Accuracy - All Images: 36.5Accuracy - Corrupted Images: 30.3…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_gaussian_noise)#61Accuracy - All Images: 36.4Accuracy - Corrupted Images: 30.2…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_frost)#63Accuracy - All Images: 36.1Accuracy - Corrupted Images: 29.7…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_fog_aws)#65Accuracy - All Images: 35.9Accuracy - Corrupted Images: 30.3…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_motion_blur)#67Accuracy - All Images: 35.7Accuracy - Corrupted Images: 30.2…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_zoom_blur)#81Accuracy - All Images: 32.7Accuracy - Corrupted Images: 28.3…
domain-generalization-on-vizwiz-classificationResNet-50 (IN-C_greyscale)#84Accuracy - All Images: 30.2Accuracy - Corrupted Images: 24.3…