| code-generation-on-mbpp | Mixtral 8x7B (3-shot) | #37 | Accuracy: 60.7 |
| common-sense-reasoning-on-arc-easy | Mixtral 8x7B (0-shot) | #10 | Accuracy: 83.1 |
| common-sense-reasoning-on-arc-easy | Mistral 7B (0-shot) | #12 | Accuracy: 80.5 |
| common-sense-reasoning-on-winogrande | Mixtral 8x7B (0-shot) | #19 | Accuracy: 77.2 |
| common-sense-reasoning-on-winogrande | Mistral 7B (0-shot) | #27 | Accuracy: 74.2 |
| math-word-problem-solving-on-math | Mixtral 8x7B (maj@4) | #79 | Accuracy: 28.4 |
| math-word-problem-solving-on-math | Mistral 7B (maj@4) | #99 | Accuracy: 12.7Parameters (Billions): 7 |
| multi-task-language-understanding-on-mmlu | Mixtral 8x7B (5-shot) | #6 | Average (%): 70.6 |
| multi-task-language-understanding-on-mmlu | Mistral 7B (5-shot) | #12 | Average (%): 62.5 |
| question-answering-on-piqa | Mixtral 8x7B (0-shot) | #12 | Accuracy: 83.6 |
| question-answering-on-piqa | Mistral 7B (0-shot) | #21 | Accuracy: 82.2 |