| agents-on-taubench-airline | Claude 3.7 Sonnet | – | Accuracy: 58.4 |
| agents-on-taubench-retail | Claude 3.7 Sonnet | – | Accuracy: 81.2 |
| code-generation-on-swe-bench-verified | Claude 3.7 Sonnet | – | Accuracy: 62.3 |
| mathematical-reasoning-on-aime24 | Claude 3.7 Sonnet | – | Acc: 23.3 |
| mathematical-reasoning-on-math-500 | Claude 3.7 Sonnet | – | Accuracy: 82.2 |
| multi-task-language-understanding-on-mmmlu | Claude 3.7 Sonnet | – | Accuracy: 83.2 |
| multimodal-reasoning-on-mmmu | Claude 3.7 Sonnet | – | Accuracy: 71.8 |
| multiple-choice-question-answering-mcqa-on-gpqa-diamond | Claude 3.7 Sonnet | – | Accuracy: 68.0 |