CoLT5: Faster Long-Range Transformers with Conditional Computation
Open paper
Benchmark
Model
Rank
Results
long-range-modeling-on-scrolls
CoLT5 XL
–
Avg.: 43.51
GovRep: 61.3/32.2/33.8
SumScr: 36.4/10.2/21.7
…
Rank counts only results with a code link.