| instruction-following-on-mtbench | Pixtral 12B | #12 | Score (1-10): 7.68 |
| multi-task-language-understanding-on-mmlu | Pixtral 12B (5-shot) | #30 | Average (%): 69.2 |
| visual-question-answering-on-docvqa-test | Pixtral 12B | #38 | ANLS: 0.907 |
| chart-question-answering-on-chartqa | Pixtral 12B | #62 | 1:1 Accuracy: 81.8 |
| code-generation-on-humaneval | Pixtral 12B | #82 | Pass@1: 72 |
| multimodal-reasoning-on-mmmu | Pixtral 12B | #90 | Accuracy: 52.0 |
| math-word-problem-solving-on-math | Pixtral 12B | #93 | Accuracy: 48.1 |
| multimodal-reasoning-on-mathvista | Pixtral 12B | #98 | Accuracy: 58.3 |