| arithmetic-reasoning-on-gsm8k | Branch-Train-MiX 4x7B (sampling top-2 experts) | #101 | Accuracy: 37.1 |
| code-generation-on-mbpp | Branch-Train-Merge 4x7B (top-2) | #69 | Accuracy: 42.6 |
| code-generation-on-mbpp | Branch-Train-MiX 4x7B (sampling top-2 experts) | #73 | Accuracy: 39.4 |
| common-sense-reasoning-on-winogrande | Branch-Train-MiX 4x7B (sampling top-1 expert) | #34 | Accuracy: 70.6 |
| math-word-problem-solving-on-math | Branch-Train-MiX 4x7B (sampling top-2 experts) | #92 | Accuracy: 17.8 |
| multi-task-language-understanding-on-mmlu | Branch-Train-MiX 4x7B (sampling top-1 experts) | #17 | Average (%): 53.2 |
| question-answering-on-triviaqa | Branch-Train-MiX 4x7B (sampling top-2 experts) | #23 | EM: 57.1 |