Introducing MPT-7B: A New Standard for Open-Source, Commercially Usable LLMs

Benchmark Model Rank Results
question-answering-on-copa-zero-shotMPT-7B#4Accuracy: 81.3
language-modelling-on-lambadaMPT-7B#23Accuracy: 70.3
question-answering-on-boolqMPT-7B#57Accuracy: 75.0
question-answering-on-piqaMPT-7B#61Accuracy: 79.9
common-sense-reasoning-on-arc-easyMPT-7B#69Accuracy: 67.3
common-sense-reasoning-on-winograndeMPT-7B#84Accuracy: 68.3
sentence-completion-on-hellaswagMPT-7B#90Accuracy: 76.1