| question-answering-on-copa-zero-shot | OLMoE-1B-7B | #5 | Accuracy: 78.0 |
| common-sense-reasoning-on-arc-easy | OLMoE-1B-7B (5-shot) | #10 | Accuracy: 84.2 |
| instruction-following-on-ifeval | OLMoE-1B-7B-Instruct | #23 | Prompt-level loose-accuracy: 48.1 |
| multi-task-language-understanding-on-mmlu | OLMoE-1B-7B (5-shot) | #58 | Average (%): 54.1 |
| question-answering-on-piqa | OLMoE-1B-7B (5-shot) | #64 | Accuracy: 79.8 |
| sentence-completion-on-hellaswag | OLMoE-1B-7B (5-shot) | #76 | Accuracy: 80.0 |
| common-sense-reasoning-on-winogrande | OLMoE-1B-7B (5-shot) | #78 | Accuracy: 70.2 |
| arithmetic-reasoning-on-gsm8k | OLMoE-1B-7B-Instruct (8-shot) | #245 | Accuracy: 45.5 |