Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Benchmark Model Rank Results
language-modelling-on-lambadaMamba-2.8B#26Accuracy: 69.2Perplexity: 4.23
common-sense-reasoning-on-arc-easyMamba-2.8B (0-shot)#60Accuracy: 69.7
common-sense-reasoning-on-winograndeMamba-2.8B#101Accuracy: 63.5
question-answering-on-piqaMamba-2.8B#114Accuracy: 75.2
sentence-completion-on-hellaswagMamba-2.8B#131Accuracy: 66.1
sentence-completion-on-hellaswagMamba-1.4B#155Accuracy: 59.1