OpenCodePapers

video-based-generative-performance-2

Video-based Generative Performance BenchmarkingVideo-based Generative Performance Benchmarking (Consistency)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodegpt-scoreModelNameReleaseDate
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance✓ Link3.81PPLLaVA-7B2024-11-04
TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models✓ Link3.69TS-LLaVA-34B2024-11-17
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models✓ Link3.57SlowFast-LLaVA-34B2024-07-22
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding✓ Link3.39VideoGPT+2024-06-13
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning✓ Link3.25PLLaVA-34B2024-04-25
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding✓ Link2.81Chat-UniVi2023-11-14
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link2.81VideoChat22023-11-28
ST-LLM: Large Language Models Are Effective Temporal Learners✓ Link2.81ST-LLM2024-03-30
MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens✓ Link2.67MiniGPT4-video-7B2024-04-04
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link2.62VideoChat2_HD_mistral2023-11-28
VTimeLLM: Empower LLM to Grasp Video Moments✓ Link2.47VTimeLLM2023-11-30
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.46BT-Adapter2023-09-27
MovieChat: From Dense Token to Sparse Memory for Long Video Understanding✓ Link2.42MovieChat2023-07-31
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models✓ Link2.37Video-ChatGPT2023-06-08
VideoChat: Chat-Centric Video Understanding✓ Link2.24Video Chat2023-05-10
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning✓ Link2.2BT-Adapter (zero-shot)2023-09-27
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model✓ Link2.15LLaMA Adapter2023-04-28
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding✓ Link1.79Video LLaMA2023-06-05
Check out how to contribute new results.