VideoChat: Chat-Centric Video Understanding

Benchmark Model Rank Results
question-answering-on-next-qa-open-ended-videoqaVideoChat#2Accuracy: 56.6Confidence Score: 3.2
zero-shot-video-question-answer-on-vnbenchVideoChat2#7Accuracy: 12.4
video-based-generative-performance-benchmarking-consistency-on-videoinstructVideo Chat#15gpt-score: 2.24
video-based-generative-performance-benchmarking-correctness-of-information-on-videoinstructVideo Chat#15gpt-score: 2.32
video-based-generative-performance-benchmarking-detail-orientation-on-videoinstructVideo Chat#15gpt-score: 2.50
zeroshot-video-question-answer-on-tgif-qaVideo Chat-7B#15Accuracy: 34.4Confidence Score: 2.3
video-based-generative-performance-benchmarking-contextual-understanding-on-videoinstructVideo Chat#16gpt-score: 2.53
video-based-generative-performance-benchmarking-temporal-understanding-on-videoinstructVideo Chat#17gpt-score: 1.94
video-based-generative-performance-benchmarking-on-videoinstructVideo Chat#21mean: 2.29Correctness of Information: 2.23Detail Orientation: 2.50…
zeroshot-video-question-answer-on-msvd-qaVideo Chat-7B#26Accuracy: 56.3Confidence Score: 2.8
zeroshot-video-question-answer-on-activitynet-qaVideo Chat#27Accuracy: 26.5Confidence Score: 2.2
zeroshot-video-question-answer-on-msrvtt-qaVideo Chat-7B#28Accuracy: 45.0Confidence Score: 2.5
video-question-answering-on-activitynet-qaVideo Chat#29Accuracy: 26.5Confidence score: 2.2
video-question-answering-on-mvbenchVideoChat#87Avg.: 35.5