| instruction-following-on-mtbench | Mixtral 8x7B Instruct | #10 | Score (1-10): 8.30 |
| common-sense-reasoning-on-arc-easy | Mixtral 8x7B (0-shot) | #15 | Accuracy: 83.1 |
| common-sense-reasoning-on-arc-easy | Mistral 7B (0-shot) | #22 | Accuracy: 80.5 |
| question-answering-on-triviaqa | Mixtral 8x7B (5-shot) | #20 | EM: 71.5 |
| question-answering-on-piqa | Mixtral 8x7B (0-shot) | #21 | Accuracy: 83.6 |
| question-answering-on-piqa | Mistral 7B (0-shot) | #37 | Accuracy: 82.2 |
| multi-task-language-understanding-on-mmlu | Mixtral 8x7B (5-shot) | #27 | Average (%): 70.6 |
| multi-task-language-understanding-on-mmlu | Mistral 7B (5-shot) | #48 | Average (%): 62.5 |
| sentence-completion-on-hellaswag | Mixtral 8x7B | #41 | Accuracy: 84.4 |
| question-answering-on-natural-questions | Mixtral 8x7B (5-shot) | #43 | EM: 30.6 |
| common-sense-reasoning-on-winogrande | Mixtral 8x7B (0-shot) | #44 | Accuracy: 77.2 |
| common-sense-reasoning-on-winogrande | Mistral 7B (0-shot) | #58 | Accuracy: 74.2 |
| code-generation-on-mbpp | Mixtral 8x7B (3-shot) | #86 | Accuracy: 60.7 |
| code-generation-on-humaneval | Mixtral 8x7B | #112 | Pass@1: 40.2 |
| math-word-problem-solving-on-math | Mixtral 8x7B (maj@4) | #144 | Accuracy: 28.4 |
| math-word-problem-solving-on-math | Mistral 7B (maj@4) | #174 | Accuracy: 12.7Parameters (Billions): 7 |
| arithmetic-reasoning-on-gsm8k | Mixtral 8x7B (8-shot) | #183 | Accuracy: 74.4 |