| Benchmark | Model | Rank | Results |
|---|---|---|---|
| machine-translation-on-iwslt2014-german | Transformer+Rep(Sim)+WDrop | #16 | BLEU score: 36.22Number of Params: 37M |
| machine-translation-on-wmt2014-english-german | Transformer+Rep(Uni) | #3 | BLEU score: 33.89SacreBLEU: 32.35 |
| text-summarization-on-duc-2004-task-1 | Transformer+WDrop | #1 | ROUGE-1: 33.06ROUGE-2: 11.45ROUGE-L: 28.51 |
| text-summarization-on-gigaword | Transformer+Rep(Uni) | #3 | ROUGE-1: 39.81ROUGE-2: 20.40ROUGE-L: 36.93 |
| text-summarization-on-gigaword | Transformer+Wdrop | #5 | ROUGE-1: 39.66ROUGE-2: 20.45ROUGE-L: 36.59 |