| arithmetic-reasoning-on-gsm8k | Claude 3.5 Sonnet | – | Accuracy: 96.4 |
| chart-question-answering-on-chartqa | Claude 3.5 Sonnet | – | 1:1 Accuracy: 90.8 |
| code-generation-on-humaneval | Claude 3.5 Sonnet | – | Pass@1: 92.0 |
| code-generation-on-humaneval | Claude Sonnet 3.5 | – | Pass@1: 90.85 |
| math-word-problem-solving-on-math | Claude 3.5 Sonnet | – | Accuracy: 71.1 |
| multi-task-language-understanding-on-mmlu | Claude 3.5 Sonnet | – | Average (%): 88.7 |
| multimodal-reasoning-on-mathvista | Claude 3.5 Sonnet | – | Accuracy: 67.7 |
| multimodal-reasoning-on-mmmu | Claude 3.5 Sonnet | – | Accuracy: 68.3 |
| multiple-choice-question-answering-mcqa-on-gpqa-diamond | Claude 3.5 Sonnet | – | Accuracy: 59.4 |
| visual-question-answering-on-docvqa-test | Claude 3.5 Sonnet | – | ANLS: 0.952 |