| Benchmark | Model | Rank | Results |
|---|---|---|---|
| machine-translation-on-wmt2016-romanian | MLM pretraining | #4 | BLEU score: 35.3 |
| unsupervised-machine-translation-on-wmt2014-1 | MLM pretraining for encoder and decoder | #4 | BLEU: 33.3 |
| unsupervised-machine-translation-on-wmt2014-2 | MLM pretraining for encoder and decoder | #4 | BLEU: 33.4 |
| unsupervised-machine-translation-on-wmt2016 | MLM pretraining for encoder and decoder | #4 | BLEU: 26.4 |
| unsupervised-machine-translation-on-wmt2016-1 | MLM pretraining for encoder and decoder | #4 | BLEU: 34.3 |