The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization

Benchmark Model Rank Results
domain-generalization-on-imagenet-cDeepAugment (ResNet-50)#36mean Corruption Error (mCE): 60.4
domain-generalization-on-imagenet-rDeepAugment+AugMix (ResNet-50)#28Top-1 Error Rate: 53.2
domain-generalization-on-imagenet-rDeepAugment (ResNet-50)#32Top-1 Error Rate: 57.8
domain-generalization-on-vizwizResNet-50 (deepaugment)#30Accuracy - All Images: 41.3Accuracy - Corrupted Images: 34.9
domain-generalization-on-vizwizResNet-50 (deepaugment+augmix)#36Accuracy - All Images: 40.3Accuracy - Corrupted Images: 34.1