Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Benchmark Model Rank Results
zero-shot-question-answering-on-openbookqaMamba-2-2.7B#17Accuracy: 38.8
language-modelling-on-lambadaMamba-2-2.7B#24Accuracy: 69.7Perplexity: 4.10
common-sense-reasoning-on-arc-easyMamba-2-2.7B#59Accuracy: 69.6
question-answering-on-piqaMamba-2-2.7B#94Accuracy: 76.4
common-sense-reasoning-on-winograndeMamba-2-2.7B#98Accuracy: 64.0
sentence-completion-on-hellaswagMamba-2-2.7B#126Accuracy: 66.6