| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-enwiki8 | Longformer (30 layers, h=512) | #14 | Bit per Character (BPC): 0.99Number of params: 102M |
| language-modelling-on-enwiki8 | Longformer (12 layers, h=512) | #17 | Bit per Character (BPC): 1.00Number of params: 41M |
| language-modelling-on-hutter-prize | Longformer Large | #5 | Bit per Character (BPC): 0.99Number of params: 102M |
| language-modelling-on-hutter-prize | Longformer Small | #6 | Bit per Character (BPC): 1.00Number of params: 41M |
| question-answering-on-wikihop | Longformer-large | #2 | Test: 81.9 |