OpenCodePapers

video-question-answering-on-mvbench

Video Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAvg.ModelNameReleaseDate
Qwen3.5-Omni Technical Report79.0Qwen3.5-Omni-Plus2026-04-21
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models✓ Link78.7InternVL3-78B2025-04-14
GLM-5.3-Flash: Frontier Intelligence, Flash Cost✓ Link77.8GLM-5.3-Flash2026-08-26
Qwen3.5: Towards Native Multimodal Agents✓ Link77.6Qwen3.5-397B-A17B2026-02-16
PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding✓ Link77.1PLM-8B2025-04-17
Qwen3.5: Towards Native Multimodal Agents✓ Link76.6Qwen3.5-122B-A10B2026-02-16
Qwen3-VL Technical Report✓ Link76.5Qwen3-VL-235B-A22B-Instruct2025-11-26
Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding✓ Link75.9Molmo2-8B2026-01-15
Qwen3.6✓ Link75.5Qwen3.6-27B2026-04-21
LongCat-Flash-Omni Technical Report✓ Link75.2LongCat-Flash-Omni2025-10-31
InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning✓ Link75.0InternVideo3-8B2026-06-10
GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning✓ Link74.9GLM-4.6V2025-07-01
Qwen3.5: Towards Native Multimodal Agents✓ Link74.8Qwen3.5-35B-A3B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link74.6Qwen3.5-27B2026-02-16
Qwen3.6✓ Link74.6Qwen3.6-35B-A3B2026-04-21
Cosmos 3: Omnimodal World Models for Physical AI✓ Link74.5Cosmos3-Super2026-06-01
Qwen3.5: Towards Native Multimodal Agents✓ Link74.4Qwen3.5-9B2026-02-16
EgoVITA: Learning to Plan and Verify for Egocentric Video Reasoning✓ Link73.8EgoVITA (InternVL-3.5)2025-11-23
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link73.6Qwen2-VL-72B2024-09-18
HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning73.31Qwen3.5-397B-A17B (RLVR w/ Multi-Hop)2026-03-17
Unified Spatio-Temporal Token Scoring for Efficient Video VLMs✓ Link72.7Molmo2 (SigLIP2 So400M + Qwen3-4B) with STTS (30%)2026-03-18
Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs✓ Link72.5Video-ORA-9B2026-08-20
TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming✓ Link72.5TLive-Omni (9B)2026-08-21
Streaming Video Instruction Tuning✓ Link72.3Streamo2025-12-24
VideoAuto-R1: Video Auto Reasoning via Thinking Once, Answering Twice✓ Link72.0VideoAuto-R1 (Qwen3-VL-8B)2026-01-08
Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs✓ Link71.6InternVL2.5-8B + TAI2026-10-01
AdaTooler-V: Adaptive Tool-Use for Images and Videos✓ Link71.5AdaTooler-V-7B2025-12-18
MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding✓ Link71.5MoE-ViE-H/14 + Llama 3.1 8B (42M alignment)2026-08-18
Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence71.32Capek0.5-35B-A3B2026-08-07
From Pixels to Words -- Towards Native One-Vision Models at Scale✓ Link70.7NEO-ov 9B2026-05-27
PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation✓ Link70.53PixelUMM 8B MoT2026-09-29
Qwen2.5-VL Technical Report✓ Link70.4Qwen2.5-VL-72B2025-02-19
What Should a Streaming Video Model Remember?70.4SelectStream-Qwen2.5-VL-7B2026-06-15
VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Context✓ Link70.4VisReflect-7B-Video2026-06-29
Qwen2.5-Omni Technical Report✓ Link70.3Qwen2.5-Omni-7B2025-03-26
CogniRoute: Learning to Route Social Evidence in Omni-Modal Models70.2CogniRoute2026-06-18
Clue Matters: Empower Video Reasoning with Brain-Inspired Latent Clue Learning69.8ClueNet2026-09-08
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding✓ Link69.7VideoLLaMA3 7B2025-01-22
Ovis2.5 Technical Report✓ Link69.7Ovis2.5-9B2025-08-15
Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazing✓ Link69.7NVILA-8B-HD-Video2026-03-12
Qwen2.5-VL Technical Report✓ Link69.6Qwen2.5-VL-7B2025-02-19
Perception Encoder: The best visual embeddings are not at the output of the network✓ Link69.4PE-Lang G2025-04-17
Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition✓ Link69.4Demo-ICL (SFT, 7B)2026-02-09
LinVT: Empower Your Image-level Large Language Model to Understand Videos✓ Link69.3LinVT-Qwen2-VL (7B)2024-12-06
TLive-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming✓ Link69.0TLive-Omni (4B)2026-08-21
VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding✓ Link68.9VideoKR (SFT + RL) on Qwen2.5-VL-7B-Instruct (Frames=128)2026-06-03
Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders✓ Link68.7Penguin-VL 8B2026-03-06
AURA: Always-On Understanding and Real-Time Assistance via Video Streams✓ Link68.1AURA2026-04-05
Tarsier: Recipes for Training and Evaluating Large Video Description Models✓ Link67.6Tarsier (34B)2024-06-30
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding✓ Link67.2InternVideo22024-03-22
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link67.0Qwen2-VL-7B2024-09-18
Qwen2.5-VL Technical Report✓ Link67.0Qwen2.5-VL-3B2025-02-19
LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding✓ Link66.9LongVU (7B)2024-10-22
MOSS-VL Technical Report✓ Link66.7MOSS-VL-Instruct-07082026-08-15
VAST: Video Ability-Stratified Taxonomy for Data-Efficient Video Reasoning66.3VideoVAST-7B (extra data)2026-06-03
LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence✓ Link66.2LLaVA-OneVision-2-8B2026-05-25
PointThinker: Point-Incentivized Parallel Thinking for Multimodal Large Language Model66.2PointThinker-7B (extra data)2026-06-03
CurveStream: Boosting Streaming Video Understanding in MLLMs via Curvature-Aware Hierarchical Visual Memory Management✓ Link66.03Qwen2.5-VL-7B (with CurveStream)2026-03-20
Let VLMs Grade Their Own Thoughts: A Self-Quantification Approach to Reasoning-Aware Reward Modeling65.9Video-RAISE-7B2026-06-03
Rethinking Chain-of-Thought Reasoning for Videos✓ Link65.6Qwen2.5-VL-7B (GRPO, concise reason, trained with token compression & 6x frames)2025-12-10
HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understanding✓ Link65.53HERMES (Qwen2.5-VL-7B, 4K tokens)2026-01-21
Reinforced Attention Learning65.5RAL2026-02-04
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model✓ Link65.5Mage-VL-4B (tc16)2026-07-27
EventLens: Event-Structure Reinforcement Learning for Video Understanding✓ Link65.42EventLens-8B2026-10-12
Less from More: Reinforcing Sparse Video Reasoning from Dense References✓ Link65.3SAVER-4B (extra data)2026-10-07
Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolution✓ Link64.7Oryx(34B)2024-09-19
Taming Hallucinations: Boosting MLLMs' Video Understanding via Counterfactual Video Generation✓ Link63.8DNA-Train-7B2025-12-30
Less Data, Faster Convergence: Goal-Driven Data Optimization for Multimodal Instruction Tuning✓ Link63.65GDO (Temp+)2026-03-12
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link63.2Qwen2-VL-2B2024-09-18
Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients62.7ZPPO (Qwen3.5-2B)2026-06-16
Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification✓ Link62.3UniAR2026-06-16
See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding✓ Link62.1SWIM2026-05-18
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs✓ Link62.0VideoLLaMA2 (72B)2024-06-11
Dynin-Omni: Omnimodal Unified Large Diffusion Language Model✓ Link62.0Dynin-Omni (8B)2026-03-09
Lance: Unified Multimodal Modeling by Multi-Task Synergy✓ Link62.0Lance (3B)2026-05-18
CoPE-VideoLM: Codec Primitives For Efficient Video Language Models61.9CoPE 7B2026-02-13
Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation✓ Link61.8Intern Lumina U2 (Ascend)2026-10-14
Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders✓ Link61.7Penguin-VL 2B2026-03-06
Puzzle Curriculum GRPO for Vision-Centric Reasoning✓ Link61.0Qwen2.5-VL-7B (Mix)2025-12-16
CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion✓ Link60.6CAt+v (Qwen2.5-VL, 3B)2025-12-22
TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning✓ Link59.9VideoChat-T (7B)2024-10-25
mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models✓ Link59.5mPLUG-Owl3(7B)2024-08-09
LLaVA-OneVision: Easy Visual Task Transfer✓ Link59.4LLaVA-OneVision-72B2024-08-06
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance✓ Link59.2PPLLaVA (7b)2024-11-04
Token Reduction via Local and Global Contexts Optimization for Efficient Video Large Language Models✓ Link59.2AOT (LLaVA-Video-7B)2026-03-02
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding✓ Link58.7VideoGPT+2024-06-13
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning✓ Link58.1PLLaVA2024-04-25
EarlyTom: Early Token Compression Completes Fast Video Understanding✓ Link57.8EarlyTom (LLaVA-OneVision-7B)2026-05-28
MASH-VLM: Mitigating Action-Scene Hallucination in Video-LLMs through Disentangled Spatial-Temporal Representations57.6MASH-VLM2025-03-20
TimeViper: A Hybrid Mamba-Transformer Vision-Language Model for Efficient Long Video Understanding✓ Link57.2TimeViper2025-11-20
DynImg: Key Frames with Visual Prompts are Good Representation for Multi-Modal Video Understanding55.8DynImg2025-07-21
ST-LLM: Large Language Models Are Effective Temporal Learners✓ Link54.9ST-LLM2024-03-30
LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models✓ Link54.9LLaVA-NeXT-Interleave 14B2024-07-10
Generation as Auxiliary Supervision: Enhancing Visual Understanding at Zero Inference Overhead via Decoupled Embedding Prediction54.6GAS (2B after pretraining)2026-08-12
TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models✓ Link54.4Tuna2025-12-01
COLT: Enhancing Video Large Language Models with Continual Tool Usage53.4COLT joint2025-09-23
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link51.9VideoChat22023-11-28
COLT: Enhancing Video Large Language Models with Continual Tool Usage51.8COLT 5x22025-09-23
COLT: Enhancing Video Large Language Models with Continual Tool Usage50.6COLT 10x12025-09-23
InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervision50.6InternVideo-Next (Large)2025-12-01
HawkEye: Training Video-Text LLMs for Grounding Text in Videos✓ Link47.55HawkEye2024-03-15
SmolVLM: Redefining small and efficient multimodal models✓ Link46.3SmolVLM 2.2B2025-04-07
SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models✓ Link39.7SPHINX-Plus2024-02-08
TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding✓ Link38.5TimeChat2023-12-04
Visual Instruction Tuning✓ Link36.0LLaVa2023-04-17
VideoChat: Chat-Centric Video Understanding✓ Link35.5VideoChat2023-05-10
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding✓ Link34.1VideoLLaMA2023-06-05
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models✓ Link32.7Video-ChatGPT2023-06-08
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning✓ Link32.5InstructBLIP2023-05-11
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models✓ Link18.8MiniGPT42023-04-20