| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-enwiki8 | Cluster-Former (#C=512) | – | Bit per Character (BPC): 1.22 |
| open-domain-question-answering-on-searchqa | Cluster-Former (#C=512) | – | EM: 68.0 |
| question-answering-on-natural-questions-long | Cluster-Former (#C=512) | – | F1: 76.5 |
| question-answering-on-quasart-t | Cluster-Former (#C=512) | – | EM: 54 |