| Benchmark | Model | Rank | Results |
|---|---|---|---|
| mmr-total-on-mrr-benchmark | Claude 3.5 Sonnet | – | Total Column Score: 463 |
| question-answering-on-newsqa | Anthropic/claude-3-7-sonnet | – | EM: 74.23F1: 82.3 |
| visual-question-answering-on-mm-vet | Claude 3.5 Sonnet (claude-3-5-sonnet-20240620) | – | GPT-4 score: 74.2±0.2 |
| visual-question-answering-on-mm-vet-v2 | Claude 3.5 Sonnet (claude-3-5-sonnet-20240620) | – | GPT-4 score: 71.8±0.2 |