| multiple-choice-question-answering-mcqa-on-arc-challenge-25-shot | Motif 3 Base (25-shot) | #1 | Accuracy: 94.71 |
| multi-task-language-understanding-on-mmlu | Motif 3 Base (5-shot) | #4 | Average (%): 86.2 |
| physics-question-answering-on-critpt | Motif 3 | #5 | Accuracy: 6.6 |
| question-answering-on-humanity-s-last-exam-hle | Motif 3 | #5 | Accuracy: 37.0 |
| instruction-following-on-ifbench | Motif 3 | #7 | Accuracy: 78.2 |
| code-generation-on-scicode | Motif 3 | #14 | Accuracy: 40.6 |
| question-answering-on-piqa | Motif 3 Base (zero-shot) | #16 | Accuracy: 85.14 |
| code-generation-on-mbpp | Motif 3 Base (3-shot) | #19 | Accuracy: 84.6 |
| code-generation-on-swe-bench-verified | Motif 3 (mini-SWE-agent) | #21 | Accuracy: 76.2 |
| sentence-completion-on-hellaswag | Motif 3 Base (10-shot) | #21 | Accuracy: 88.3 |
| code-generation-on-terminal-bench-2-1 | Motif 3 (Terminus 2) | #22 | Accuracy: 74.9 |
| common-sense-reasoning-on-winogrande | Motif 3 Base (5-shot) | #28 | Accuracy: 80.9 |
| math-word-problem-solving-on-math | Motif 3 Base (4-shot CoT) | #33 | Accuracy: 70.58 |
| arithmetic-reasoning-on-gsm8k | Motif 3 Base (8-shot CoT) | #36 | Accuracy: 93.93 |
| multiple-choice-question-answering-mcqa-on-gpqa-diamond | Motif 3 | #46 | Accuracy: 83.4 |
| multi-task-language-understanding-on-mmlu-pro | Motif 3 Base (5-shot CoT) | #76 | Accuracy: 68.56 |
| code-generation-on-humaneval | Motif 3 Base (zero-shot) | #78 | Pass@1: 73.7 |