Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics

Benchmark Model Rank Results
zero-shot-question-answering-on-sciqEFLA#8Accuracy: 84.2
language-modelling-on-lambadaEFLA#59Accuracy: 43.2Perplexity: 16.54
question-answering-on-boolqEFLA#102Accuracy: 60.4
question-answering-on-piqaEFLA#159Accuracy: 68.9
common-sense-reasoning-on-winograndeEFLA#162Accuracy: 52.1
sentence-completion-on-hellaswagEFLA#190Accuracy: 44.5