PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning

Benchmark Model Rank Results
video-based-generative-performance-benchmarking-contextual-understanding-on-videoinstructPLLaVA-34B#2gpt-score: 3.9
video-based-generative-performance-benchmarking-correctness-of-information-on-videoinstructPLLaVA-34B#2gpt-score: 3.60
video-based-generative-performance-benchmarking-detail-orientation-on-videoinstructPLLaVA-34B#2gpt-score: 3.20
zeroshot-video-question-answer-on-activitynet-qaPLLaVA (34B)#2Accuracy: 60.9Confidence Score: 3.7
zeroshot-video-question-answer-on-msrvtt-qaPLLaVA (34B)#2Accuracy: 68.7Confidence Score: 3.6
video-based-generative-performance-benchmarking-on-videoinstructPLLaVA-34B#4mean: 3.32Correctness of Information: 3.60Detail Orientation: 3.20…
zeroshot-video-question-answer-on-tgif-qaPLLaVA#4Accuracy: 80.6Confidence Score: 4.3
video-based-generative-performance-benchmarking-consistency-on-videoinstructPLLaVA-34B#5gpt-score: 3.25
zeroshot-video-question-answer-on-msvd-qaPLLaVA (34B)#5Accuracy: 79.9Confidence Score: 4.2
video-based-generative-performance-benchmarking-temporal-understanding-on-videoinstructPLLaVA-34B#6gpt-score: 2.67
video-question-answering-on-tvbenchPLLaVA-34B#15Average Accuracy: 42.3
video-question-answering-on-tvbenchPLLaVA-13B#19Average Accuracy: 36.4
video-question-answering-on-tvbenchPLLaVA-7B#22Average Accuracy: 34.9
video-question-answering-on-mvbenchPLLaVA#75Avg.: 58.1