Fast Weight Attention for Continual Learning

Benchmark Model Rank Results
zero-shot-question-answering-on-openbookqaFalcon-1A.2130M#21Accuracy: 33.2
language-modelling-on-lambadaFalcon-1A.1130M#79Perplexity: 47.93
question-answering-on-piqaFalcon-1A.2130M#152Accuracy: 67.03
common-sense-reasoning-on-winograndeFalcon-1A.2130M#156Accuracy: 52.96
sentence-completion-on-hellaswagFalcon-1.3130M#205Accuracy: 38.38