OpenCodePapers

video-based-generative-performance-1

Video-based Generative Performance BenchmarkingVideo-based Generative Performance Benchmarking (Correctness of Information)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodegpt-scoreModelNameReleaseDate
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance✓ Link3.85PPLLaVA-7B2024-11-04
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning✓ Link3.60PLLaVA-34B2024-04-25
TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models✓ Link3.55TS-LLaVA-34B2024-11-17
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models✓ Link3.48SlowFast-LLaVA-34B2024-07-22
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link3.40VideoChat2_HD_mistral2023-11-28
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding✓ Link3.27VideoGPT+2024-06-13
ST-LLM: Large Language Models Are Effective Temporal Learners✓ Link3.23ST-LLM2024-03-30
MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens✓ Link3.08MiniGPT4-video-7B2024-04-04
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link3.02VideoChat22023-11-28
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding✓ Link2.89Chat-UniVi2023-11-14
VTimeLLM: Empower LLM to Grasp Video Moments✓ Link2.78VTimeLLM2023-11-30
MovieChat: From Dense Token to Sparse Memory for Long Video Understanding✓ Link2.76MovieChat2023-07-31
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.68BT-Adapter2023-09-27
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models✓ Link2.40Video-ChatGPT2023-06-08
VideoChat: Chat-Centric Video Understanding✓ Link2.32Video Chat2023-05-10
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.16BT-Adapter (zero-shot)2023-09-27
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model✓ Link2.03LLaMA Adapter2023-04-28
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding✓ Link1.96Video LLaMA2023-06-05
Check out how to contribute new results.