Transformer Quality in Linear Time
Open paper
Benchmark
Model
Rank
Results
language-modelling-on-wiki-40b
FLASH-Quad-8k
#1
Perplexity: 14.998
Rank counts only results with a code link.