| Paper | Code | Avg | Image | ListOps | Pathfinder | Text | Retrieval | Pathfinder-X | ModelName | ReleaseDate |
|---|---|---|---|---|---|---|---|---|---|---|
| Simplified State Space Layers for Sequence Modeling | ✓ Link | 87.46 | 88 | 62.15 | 95.33 | 89.31 | 91.4 | 98.58 | S5 | 2022-08-09 |
| How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections | ✓ Link | 86.09 | 88.65 | 59.60 | 94.20 | 86.82 | 90.90 | 96.35 | S4 | 2022-06-24 |
| Converting Transformers into DGNNs Form | ✓ Link | 75.94 | 61.02 | 60.38 | 88.43 | 86.44 | 83.41 | Converter | 2025-02-01 | |
| Long Range Arena: A Benchmark for Efficient Transformers | ✓ Link | 54.39 | 42.44 | 36.37 | 71.4 | 64.27 | 57.46 | Transformer | 2020-11-08 | |
| Long Range Arena: A Benchmark for Efficient Transformers | ✓ Link | 51.41 | 42.77 | 18.01 | 77.05 | 65.4 | 53.82 | Performer | 2020-11-08 | |
| Long Range Arena: A Benchmark for Efficient Transformers | ✓ Link | 51.24 | 44.24 | 17.07 | 71.71 | 63.58 | 59.59 | Sparse Trans. | 2020-11-08 | |
| Long Range Arena: A Benchmark for Efficient Transformers | ✓ Link | 50.55 | 42.34 | 16.13 | 75.3 | 65.9 | 53.09 | Linear Trans. | 2020-11-08 |