GateLoop: Fully Data-Controlled Linear Recurrence for Sequence Modeling
Open paper
Benchmark
Model
Rank
Results
language-modelling-on-wikitext-103
GateLoop (125M)
#8
Test perplexity: 13.4
Number of params: 125M
Rank counts only results with a code link.