| instruction-following-on-mtbench | SmolLM2 1.7B Instruct | #15 | Score (1-10): 6.13 |
| question-answering-on-natural-questions | SmolLM2 1.7B | #64 | EM: 8.7 |
| question-answering-on-piqa | SmolLM2 1.7B | #76 | Accuracy: 77.6 |
| question-answering-on-piqa | SmolLM2 1.7B Instruct | #112 | Accuracy: 74.4 |
| sentence-completion-on-hellaswag | SmolLM2 1.7B | #114 | Accuracy: 68.7 |
| sentence-completion-on-hellaswag | SmolLM2 1.7B Instruct | #132 | Accuracy: 66.1 |
| common-sense-reasoning-on-winogrande | SmolLM2 1.7B | #123 | Accuracy: 59.4 |
| code-generation-on-humaneval | SmolLM2 1.7B Instruct | #124 | Pass@1: 28.1 |
| code-generation-on-humaneval | SmolLM2 1.7B | #129 | Pass@1: 22.6 |
| multi-task-language-understanding-on-mmlu-pro | SmolLM2 1.7B | #134 | Accuracy: 19.4 |
| multi-task-language-understanding-on-mmlu-pro | SmolLM2 1.7B Instruct | #135 | Accuracy: 19.3 |
| math-word-problem-solving-on-math | SmolLM2 1.7B Instruct | #156 | Accuracy: 21.0 |
| math-word-problem-solving-on-math | SmolLM2 1.7B | #172 | Accuracy: 11.6 |
| arithmetic-reasoning-on-gsm8k | SmolLM2 1.7B Instruct | #231 | Accuracy: 48.8 |
| arithmetic-reasoning-on-gsm8k | SmolLM2 1.7B | #249 | Accuracy: 31.1 |