| instruction-following-on-mtbench | Falcon-H1-34B-Instruct | #2 | Score (1-10): 9.20 |
| multi-task-language-understanding-on-mgsm | Falcon-H1-34B-Instruct (8-shot) | #7 | Average (%): 76.33 |
| multi-task-language-understanding-on-mmlu | Falcon-H1-34B-Instruct (5-shot) | #10 | Average (%): 84.05 |
| code-generation-on-mbpp | Falcon-H1-34B-Instruct | #21 | Accuracy: 83.86 |
| code-generation-on-humaneval | Falcon-H1-34B-Instruct | #39 | Pass@1: 87.2 |
| code-generation-on-livecodebench-v6 | Falcon-H1-34B-Instruct | #50 | Pass@1: 49.71 |
| sentence-completion-on-hellaswag | Falcon-H1-34B-Instruct | #61 | Accuracy: 81.94 |
| mathematical-reasoning-on-math-500 | Falcon-H1-34B-Instruct | #78 | Accuracy: 83.80 |
| multi-task-language-understanding-on-mmlu-pro | Falcon-H1-34B-Instruct (5-shot) | #99 | Accuracy: 58.73 |
| mathematical-reasoning-on-aime24 | Falcon-H1-34B-Instruct | #112 | Acc: 23.75 |
| multiple-choice-question-answering-mcqa-on-gpqa-diamond | Falcon-H1-34B-Instruct | #112 | Accuracy: 49.66 |
| arithmetic-reasoning-on-gsm8k | Falcon-H1-34B-Instruct (5-shot) | #128 | Accuracy: 83.62 |
| mathematical-reasoning-on-aime-2025 | Falcon-H1-34B-Instruct | #133 | Accuracy: 16.67 |