| Benchmark | Model | Rank | Results |
|---|---|---|---|
| machine-translation-on-wmt2017-chinese-english | T2R + Pretrain | #2 | BLEU: 23.8 |
| machine-translation-on-wmt2014-english-french | T2R + Pretrain | #19 | BLEU score: 42.1 |
| machine-translation-on-wmt2014-english-german | T2R + Pretrain | #34 | BLEU score: 28.7 |
| language-modelling-on-wikitext-103 | T2R + Pretrain | #45 | Test perplexity: 19.6Validation perplexity: 19 |