| language-modelling-on-penn-treebank-word | AWD-LSTM-DRILL + dynamic eval | #11 | Test perplexity: 49.4Validation perplexity: 49.5Params: 24M |
| language-modelling-on-penn-treebank-word | AWD-LSTM-DRILL | #24 | Test perplexity: 55.7Validation perplexity: 58.2Params: 24M |
| language-modelling-on-wikitext-2 | AWD-LSTM-DRILL + dynamic eval | #16 | Test perplexity: 42.0Validation perplexity: 43.9Number of params: 34M |
| language-modelling-on-wikitext-2 | AWD-LSTM-DRILL | #27 | Test perplexity: 61.9Validation perplexity: 64.9Number of params: 34M |
| machine-translation-on-wmt2014-english-german | Transformer-DRILL Base | #41 | BLEU score: 28.1 |