OpenCodePapers

video-based-generative-performance-3

Video-based Generative Performance BenchmarkingVideo-based Generative Performance Benchmarking (Contextual Understanding)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodegpt-scoreModelNameReleaseDate
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance✓ Link4.21PPLLaVA-7B2024-11-04
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning✓ Link3.9PLLaVA-34B2024-04-25
TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models✓ Link3.86TS-LLaVA-34B2024-11-17
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models✓ Link3.84SlowFast-LLaVA-34B2024-07-22
ST-LLM: Large Language Models Are Effective Temporal Learners✓ Link3.74ST-LLM2024-03-30
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding✓ Link3.74VideoGPT+2024-06-13
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link3.64VideoChat2_HD_mistral2023-11-28
MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens✓ Link3.57MiniGPT4-video-7B2024-04-04
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link3.51VideoChat22023-11-28
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding✓ Link3.46Chat-UniVi2023-11-14
VTimeLLM: Empower LLM to Grasp Video Moments✓ Link3.40VTimeLLM2023-11-30
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link3.27BT-Adapter2023-09-27
MovieChat: From Dense Token to Sparse Memory for Long Video Understanding✓ Link3.01MovieChat2023-07-31
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.89BT-Adapter (zero-shot)2023-09-27
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models✓ Link2.62Video-ChatGPT2023-06-08
VideoChat: Chat-Centric Video Understanding✓ Link2.53Video Chat2023-05-10
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model✓ Link2.30LLaMA Adapter2023-04-28
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding✓ Link2.16Video LLaMA2023-06-05
Check out how to contribute new results.