| code-generation-on-humaneval | Gemini 1.5 Pro | – | Pass@1: 84.1 |
| fs-mevqa-on-sme | Gemini-1.5 Pro | #3 | BLEU-4: 41.87METEOR: 34.61ROUGE-L: 55.90CIDEr: 276.14… |
| long-context-understanding-on-mmneedle | Gemini Pro 1.5 | #3 | 1 Image, 4*4 Stitching, Exact Accuracy: 39.85… |
| question-answering-on-newsqa | Google/Gemini 2.5 Pro | #7 | EM: 68.75F1: 79.91 |
| temporal-relation-extraction-on-vinoground | Gemini-1.5-Pro (CoT) | #5 | Text Score: 37Video Score: 27.6Group Score: 12.4 |
| temporal-relation-extraction-on-vinoground | Gemini-1.5-Pro | #7 | Text Score: 35.8Video Score: 22.6Group Score: 10.2 |
| video-question-answering-on-ovbench | Gemini-1.5-Flash | #2 | AVG: 50.7 |
| video-question-answering-on-tvbench | Gemini 1.5 Pro | #11 | Average Accuracy: 47.6 |
| visual-question-answering-on-mm-vet | Gemini 1.5 Pro (gemini-1.5-pro-002) | #1 | GPT-4 score: 76.9±0.1 |
| visual-question-answering-on-mm-vet | Gemini 1.5 Pro (gemini-1.5-pro) | #13 | GPT-4 score: 65.8±0.1 |
| visual-question-answering-on-mm-vet-v2 | Gemini 1.5 Pro | #3 | GPT-4 score: 66.9±0.2 |
| zero-shot-video-question-answer-on-video-mme | Gemini 1.5 Pro | #2 | Accuracy (%): 71.9 |
| zero-shot-video-question-answer-on-video-mme | Gemini 1.5 Flash | #3 | Accuracy (%): 66.3 |
| zero-shot-video-question-answer-on-video-mme-1 | Gemini 1.5 Pro | #1 | Accuracy (%): 81.3 |
| zero-shot-video-question-answer-on-video-mme-1 | Gemini 1.5 Flash | #3 | Accuracy (%): 75.0 |
| zero-shot-video-question-answer-on-vnbench | Gemini | #2 | Accuracy: 66.7 |
| zero-shot-video-question-answer-on-zero-shot | Gemini 1.5 Pro | #1 | Accuracy (% ): 66.7 |