| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-enwiki8 | Transformer-LS (large) | #9 | Bit per Character (BPC): 0.97Number of params: 110M |
| language-modelling-on-enwiki8 | Transformer-LS (small) | #15 | Bit per Character (BPC): 0.99 |
| language-modelling-on-text8 | Transformer-LS (small) | #6 | Bit per Character (BPC): 1.09 |