| machine-translation-on-wmt2016-romanian-english | MLM pretraining | #4 | BLEU score: 35.3 |
| unsupervised-machine-translation-on-wmt2014-english-french | MLM pretraining for encoder and decoder | #4 | BLEU: 33.4 |
| unsupervised-machine-translation-on-wmt2014-french-english | MLM pretraining for encoder and decoder | #4 | BLEU: 33.3 |
| unsupervised-machine-translation-on-wmt2016-english-german | MLM pretraining for encoder and decoder | #4 | BLEU: 26.4 |
| unsupervised-machine-translation-on-wmt2016-german-english | MLM pretraining for encoder and decoder | #4 | BLEU: 34.3 |