| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-one-billion-word | Adaptive Input Very Large | #7 | PPL: 23.02Number of params: 1.0BValidation perplexity: 22.92 |
| language-modelling-on-one-billion-word | Adaptive Input Large | #11 | PPL: 23.91Number of params: 0.46BValidation perplexity: 23.83 |
| language-modelling-on-wikitext-103 | Transformer (Adaptive inputs) | #40 | Test perplexity: 18.70Validation perplexity: 17.97… |