OpenCodePapers

video-based-generative-performance-5

Video-based Generative Performance BenchmarkingVideo-based Generative Performance Benchmarking (Temporal Understanding)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodegpt-scoreModelNameReleaseDate
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance✓ Link3.21PPLLaVA-7B2024-11-04
ST-LLM: Large Language Models Are Effective Temporal Learners✓ Link2.93ST-LLM2024-03-30
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding✓ Link2.83VideoGPT+2024-06-13
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models✓ Link2.77SlowFast-LLaVA-34B2024-07-22
TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models✓ Link2.77TS-LLaVA-34B2024-11-17
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning✓ Link2.67PLLaVA-34B2024-04-25
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link2.66VideoChat22023-11-28
MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens✓ Link2.65MiniGPT4-video-7B2024-04-04
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link2.65VideoChat2_HD_mistral2023-11-28
VTimeLLM: Empower LLM to Grasp Video Moments✓ Link2.49VTimeLLM2023-11-30
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding✓ Link2.39Chat-UniVi2023-11-14
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.34BT-Adapter2023-09-27
MovieChat: From Dense Token to Sparse Memory for Long Video Understanding✓ Link2.24MovieChat2023-07-31
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.13BT-Adapter (zero-shot)2023-09-27
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models✓ Link1.98Video-ChatGPT2023-06-08
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model✓ Link1.98LLaMA Adapter2023-04-28
VideoChat: Chat-Centric Video Understanding✓ Link1.94Video Chat2023-05-10
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding✓ Link1.82Video LLaMA2023-06-05
Check out how to contribute new results.