| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-one-billion-word | Evolved Transformer Big | #16 | PPL: 28.6 |
| machine-translation-on-wmt2014-english-french | Evolved Transformer Big | #25 | BLEU score: 41.3 |
| machine-translation-on-wmt2014-english-french | Evolved Transformer Base | #28 | BLEU score: 40.6 |
| machine-translation-on-wmt2014-english-german | Evolved Transformer Big | #16 | BLEU score: 29.8SacreBLEU: 29.2Number of Params: 218M |
| machine-translation-on-wmt2014-english-german | Evolved Transformer Base | #39 | BLEU score: 28.4Hardware Burden: 2488G |