| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-enwiki8 | Routing Transformer (12 layers) | #13 | Bit per Character (BPC): 0.99 |
| language-modelling-on-wikitext-103 | Routing Transformer | #13 | Test perplexity: 15.8 |
| image-generation-on-imagenet-64x64 | Routing Transformer | #36 | Bits per dim: 3.43 |