| arithmetic-reasoning-on-gsm8k | Claude 3 Haiku (0-shot chain-of-thought) | – | Accuracy: 88.9 |
| arithmetic-reasoning-on-gsm8k | Claude 3 Opus (0-shot chain-of-thought) | – | Accuracy: 95 |
| arithmetic-reasoning-on-gsm8k | Claude 3 Sonnet (0-shot chain-of-thought) | – | Accuracy: 92.3 |
| code-generation-on-mbpp | Claude 3 Haiku | – | Accuracy: 80.4 |
| code-generation-on-mbpp | Claude 3 Opus | – | Accuracy: 86.4 |
| code-generation-on-mbpp | Claude 3 Sonnet | – | Accuracy: 79.4 |
| common-sense-reasoning-on-winogrande | Claude 3 Haiku (5-shot) | – | Accuracy: 74.2 |
| common-sense-reasoning-on-winogrande | Claude 3 Opus (5-shot) | – | Accuracy: 88.5 |
| common-sense-reasoning-on-winogrande | Claude 3 Sonnet (5-shot) | – | Accuracy: 75.1 |
| long-context-understanding-on-mmneedle | Claude 3 Opus | – | 1 Image, 4*4 Stitching, Exact Accuracy: 12.3… |
| multi-task-language-understanding-on-mmlu | Claude 3 Haiku (5-shot) | – | Average (%): 75.2 |
| multi-task-language-understanding-on-mmlu | Claude 3 Sonnet (5-shot) | – | Average (%): 79 |
| question-answering-on-pubmedqa | Claude 3 Opus (5-shot) | – | Accuracy: 75.8 |
| question-answering-on-pubmedqa | Claude 3 Opus (zero-shot) | – | Accuracy: 74.9 |