Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

Benchmark Model Rank Results
video-text-retrieval-on-test-of-timeVideo-LLAMA#12-Class Accuracy: 88.33
video-based-generative-performance-benchmarking-consistency-on-videoinstructVideo LLaMA#18gpt-score: 1.79
video-based-generative-performance-benchmarking-contextual-understanding-on-videoinstructVideo LLaMA#18gpt-score: 2.16
video-based-generative-performance-benchmarking-correctness-of-information-on-videoinstructVideo LLaMA#18gpt-score: 1.96
video-based-generative-performance-benchmarking-detail-orientation-on-videoinstructVideo LLaMA#18gpt-score: 2.18
video-based-generative-performance-benchmarking-temporal-understanding-on-videoinstructVideo LLaMA#18gpt-score: 1.82
video-based-generative-performance-benchmarking-on-videoinstructVideo LLaMA#23mean: 1.98Correctness of Information: 1.96Detail Orientation: 2.18…
zeroshot-video-question-answer-on-msvd-qaVideo LLaMA-7B#28Accuracy: 51.6Confidence Score: 2.5
zeroshot-video-question-answer-on-activitynet-qaVideo LLaMA#29Accuracy: 12.4Confidence Score: 1.1
zeroshot-video-question-answer-on-msrvtt-qaVideo LLaMA-7B#30Accuracy: 29.6Confidence Score: 1.8
video-question-answering-on-mvbenchVideoLLaMA#88Avg.: 34.1