Mistral 7B

Benchmark Model Rank Results
answerability-prediction-on-peerqaMistral-IT-v02-7B-32k#1Macro F1: 0.4703
question-answering-on-peerqaMistral-v02-7B-32k#2Prometheus-2 Answer Correctness: 3.4245Rouge-L: 0.1922…
zero-shot-video-question-answer-on-next-gqaMistral (7B)#8Acc@GQA: 9.2
zero-shot-video-question-answer-on-intentqaMistral (7B)#11Accuracy: 50.4
instruction-following-on-mtbenchMistral 7B Instruct#14Score (1-10): 6.84
common-sense-reasoning-on-arc-challengeMistral 7B (0-shot)#20Accuracy: 55.5
common-sense-reasoning-on-arc-easyMistral 7B (0-shot)#24Accuracy: 80.0
question-answering-on-triviaqaMistral 7B (5-shot)#24EM: 69.9
zero-shot-video-question-answer-on-next-qaMistral (7B)#25Accuracy: 51.1
question-answering-on-piqaMistral 7B (0-shot)#27Accuracy: 83.0
question-answering-on-natural-questionsMistral 7B (5-shot)#47EM: 28.8
multi-task-language-understanding-on-mmluMistral 7B (5-shot)#51Average (%): 60.1
common-sense-reasoning-on-winograndeMistral 7B (0-shot)#55Accuracy: 75.3
sentence-completion-on-hellaswagMistral 7B (0-shot)#64Accuracy: 81.3
code-generation-on-mbppMistral 7B (3-shot)#115Accuracy: 47.5
code-generation-on-humanevalMistral 7B#121Pass@1: 30.5
math-word-problem-solving-on-mathMistral 7B (maj@4)#172Accuracy: 13.1Parameters (Billions): 7
arithmetic-reasoning-on-gsm8kMistral 7B (maj@8)#232Accuracy: 52.2Parameters (Billion): 7