FNetAR: Mixing Tokens with Autoregressive Fourier Transforms
Open paper
Benchmark
Model
Rank
Results
language-modelling-on-wikitext-103
FNetAR Medium
#59
Test perplexity: 25.81
Number of params: 144.4M
Rank counts only results with a code link.