MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens

Benchmark Model Rank Results
video-based-generative-performance-1MiniGPT4-video-7B#8gpt-score: 3.08
video-based-generative-performance-2MiniGPT4-video-7B#9gpt-score: 2.67
video-based-generative-performance-3MiniGPT4-video-7B#8gpt-score: 3.57
video-based-generative-performance-4MiniGPT4-video-7B#7gpt-score: 3.02
video-based-generative-performance-5MiniGPT4-video-7B#9gpt-score: 2.65
zero-shot-video-question-answer-on-tvqaMiniGPT4-video-7B#3Accuracy: 54.21
zeroshot-video-question-answer-on-activitynetMiniGPT4-video-7B#18Accuracy: 46.3
zeroshot-video-question-answer-on-msrvtt-qaMiniGPT4-video-7B#13Accuracy: 59.73
zeroshot-video-question-answer-on-msvd-qaMiniGPT4-video-7B#13Accuracy: 73.92
zeroshot-video-question-answer-on-tgif-qaMiniGPT4-video-7B#8Accuracy: 72.22