| question-answering-on-wikihop | Longformer-large | #2 | Test: 81.9 |
| language-modelling-on-hutter-prize | Longformer Large | #5 | Bit per Character (BPC): 0.99Number of params: 102M |
| language-modelling-on-hutter-prize | Longformer Small | #6 | Bit per Character (BPC): 1.00Number of params: 41M |
| language-modelling-on-text8 | Longformer Small | #7 | Bit per Character (BPC): 1.10 |
| text-summarization-on-arxiv | LED Large | #9 | ROUGE-1: 46.63ROUGE-2: 19.62ROUGE-L: 41.83 |
| language-modelling-on-enwiki8 | Longformer (30 layers, h=512) | #14 | Bit per Character (BPC): 0.99Number of params: 102M |
| language-modelling-on-enwiki8 | Longformer (12 layers, h=512) | #17 | Bit per Character (BPC): 1.00Number of params: 41M |