AutoDropout: Learning Dropout Patterns to Regularize Deep Networks

Benchmark Model Rank Results
machine-translation-on-iwslt2014-german-englishTransformerBase + AutoDropout#17BLEU score: 35.8
language-modelling-on-penn-treebank-word-levelTransformer-XL + AutoDropout#22Test perplexity: 54.9Validation perplexity: 58.1
machine-translation-on-wmt2014-english-frenchTransformerBase + AutoDropout#34BLEU score: 40
image-classification-on-cifar-10WRN-28-10+AutoDropout+RandAugment#84Percentage correct: 97.9
image-classification-on-cifar-10AutoDropout#123Percentage correct: 96.8
image-classification-on-imagenetResNet-50+AutoDropout+RandAugment#748Top 1 Accuracy: 80.3%
image-classification-on-imagenetResNet-50#847Top 1 Accuracy: 78.7%
image-classification-on-imagenetEfficientNet-B0#914Top 1 Accuracy: 77.5%