LLaVA-OneVision: Easy Visual Task Transfer

Benchmark Model Rank Results
visual-question-answering-vqa-on-vibe-evalLLaVA-OneVision-72B#1Accuracy: 50.7
temporal-relation-extraction-on-vinogroundLLaVA-OneVision-Qwen2-72B#2Text Score: 48.4Video Score: 35.2Group Score: 21.8
temporal-relation-extraction-on-vinogroundLLaVA-OneVision-Qwen2-7B#3Text Score: 41.6Video Score: 29.4Group Score: 14.6
video-question-answering-on-implicitqaLLaVA-OneVision - 7B#3Average Accuracy: 43.4Macro Average Accuracy: 46.4
zero-shot-video-question-answer-on-vnbenchLLaVA-OneVision-72B#3Accuracy: 58.7
zero-shot-video-question-answer-on-vnbenchLLaVA-OneVision-7B#4Accuracy: 51.8
visual-question-answering-vqa-on-seed-seedbenchLLaVA-OneVision-72B#5Accuracy: 78.0
video-question-answering-on-ovbenchLLaVA-OneVision (7B)#6AVG: 49.5
visual-question-answering-vqa-on-vlm2-benchLLaVA-OneVision-7B#6GC-mat: 16.60GC-trk: 13.70OC-cpr: 47.22OC-cnt: 56.17…
zero-shot-video-question-answer-on-longvideobenchLLaVA-OneVision-72B#6Accuracy (% ): 61.3
visual-question-answering-vqa-on-infographicvqaLLaVA-OneVision-72B#10ANLS: 74.9
visual-question-answering-vqa-on-mmeLLaVA-OneVision-72B#11Score: 2261
video-question-answering-on-next-qaLLaVA-OV(72B)#12Accuracy: 80.2
video-question-answering-on-next-qaLLaVA-OV(7B)#14Accuracy: 79.4
3d-question-answering-3d-qa-on-scanqa-test-w-objectsLLaVA-NeXT-Video#15Exact Match: 18.7BLEU-4: 9.8ROUGE: 27.8METEOR: 9.1CIDEr: 46.2
visual-question-answering-on-v-benchLLaVA-OneVision7B#19Accuracy: 74.46
3d-question-answering-3d-qa-on-sqa3dLLaVA-NeXT-Video#20Exact Match: 34.2
zero-shot-video-question-answer-on-egoschema-fullsetLLaVA-OneVision-72B#22Accuracy: 62.0
video-question-answering-on-video-mme-with-subtitlesLLaVA-OneVision-72B (w/ subtitles)#27Accuracy: 69.5
visual-question-answering-on-mm-vetLLaVA-OneVision-72B#30GPT-4 score: 63.7
visual-question-answering-on-mm-vetLLaVA-OneVision-7B#51GPT-4 score: 57.5
visual-question-answering-on-mm-vetLLaVA-OneVision-0.5B#184GPT-4 score: 29.1
visual-question-answering-on-docvqa-testLLaVA-OneVision-72B#36ANLS: 0.913
visual-question-answering-vqa-on-blinkLLaVA-OneVision-72B#37Accuracy: 55.4
zero-shot-video-question-answer-on-video-mme-w-o-subsLLaVA-OneVision-72B#38Accuracy (%): 66.2
visual-question-answering-vqa-on-realworldqaLLaVA-OneVision-72B#41Accuracy: 71.9
video-question-answering-on-mlvuLLaVA-OneVision-72B#44Accuracy: 68.0
chart-question-answering-on-chartqaLLaVA-OneVision-72B#531:1 Accuracy: 83.7
vision-language-understanding-on-mmstarLLaVA-OneVision-72B#59Accuracy: 66.1
multimodal-reasoning-on-mmmuLLaVA-OneVision-72B#69Accuracy: 56.8
video-question-answering-on-mvbenchLLaVA-OneVision-72B#71Avg.: 59.4
multimodal-reasoning-on-mathvistaLLaVA-OneVision-72B#76Accuracy: 67.5