RWKV: Reinventing RNNs for the Transformer Era

Benchmark Model Rank Results
language-modelling-on-lambadaRWKV-4 14B#20Accuracy: 71.05Perplexity: 3.81
natural-language-inference-on-wnliRWKV-4-Raven-14B#22Accuracy: 49.3
question-answering-on-piqaRWKV-4 14B#85Accuracy: 77.42
common-sense-reasoning-on-winograndeRWKV-4 14B#103Accuracy: 62.98
sentence-completion-on-hellaswagRWKV-4 14B#110Accuracy: 70.24