R-Drop: Regularized Dropout for Neural Networks

Benchmark Model Rank Results
abstractive-text-summarization-on-cnn-dailyBART + R-Drop#9ROUGE-1: 44.51ROUGE-2: 21.58ROUGE-L: 41.24
machine-translation-on-iwslt2014-germanTransformer + R-Drop + Cutoff#5BLEU score: 37.90
machine-translation-on-iwslt2014-germanTransformer + R-Drop#10BLEU score: 37.25
machine-translation-on-wmt2014-english-frenchTransformer + R-Drop#4BLEU score: 43.95
machine-translation-on-wmt2014-english-germanTransformer + R-Drop#6BLEU score: 30.91Hardware Burden: 49G