OpenCodePapers

video-question-answering-on-mlvu

Video Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Qwen3.5: Towards Native Multimodal Agents✓ Link87.3Qwen3.5-122B-A10B2026-02-16
Qwen3.5-Omni Technical Report86.8Qwen3.5-Omni-Plus2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link86.7Qwen3.5-397B-A17B2026-02-16
Qwen3.6✓ Link86.6Qwen3.6-27B2026-04-21
Qwen3.6✓ Link86.2Qwen3.6-35B-A3B2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link85.9Qwen3.5-27B2026-02-16
VideoJev: System One Model for Video Understanding and Interaction✓ Link85.9VideoJev-35B-A3B2026-10-13
Qwen3.5: Towards Native Multimodal Agents✓ Link85.6Qwen3.5-35B-A3B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link84.4Qwen3.5-9B2026-02-16
Qwen3-VL Technical Report✓ Link84.3Qwen3-VL-235B-A22B-Instruct2025-11-26
Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding84.3Active Video Perception (Gemini-2.5-Pro)2025-12-05
META: Meta Evolution of Tool Trajectory Adaptation for Long-Video Understanding83.6Qwen3-VL+META2026-06-03
Kwai Keye-VL-2.0 Technical Report✓ Link82.8Keye-VL-2.0-30B-A3B2026-06-09
HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning82.52Qwen3.5-397B-A17B (RLVR w/ Multi-Hop)2026-03-17
VideoJev: System One Model for Video Understanding and Interaction✓ Link80.6VideoJev-4B2026-10-13
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models✓ Link79.5InternVL3-78B2025-04-14
Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding77.6ReMem (Qwen3-VL-8B-Instruct, 32 frames)2026-06-30
InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning✓ Link77.3InternVideo3-8B2026-06-10
OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning77.1OmniSeek (ours)2026-10-01
AdaptToken: Entropy-based Adaptive Token Selection for MLLM Long Video Understanding✓ Link76.8Qwen2.5-VL + AdaptToken2026-03-30
QCA: Query- and Content-Aware Keyframe Selection for Long Video Understanding✓ Link76.8QCA2026-07-01
Divide, then Ground: Adapting Frame Selection to Query Types for Long-Form Video Understanding✓ Link76.66DIG (Qwen2.5-VL-32B)2025-12-03
LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence✓ Link76.6LLaVA-OneVision-2-8B2026-05-25
MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction✓ Link76.5MiniCPM-o 4.5-Instruct2026-04-30
EventSTU: Event-Guided Efficient Spatio-Temporal Understanding for Video-LLMs76.49EventSTU (Qwen3-VL-8B)2026-09-08
Ovis2.5 Technical Report✓ Link76.4Ovis2.5-9B2025-08-15
ReQuest: Rethinking-based Question-Aware Frame Selection for Long-Form Video QA✓ Link76.2Qwen3-VL + ReQuest2026-07-02
Qwen3-Omni Technical Report✓ Link75.7Qwen3-Omni-Flash-Instruct2025-09-22
Small Vision-Language Models are Smart Compressors for Long Video Understanding✓ Link75.6Tempo2026-04-09
MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe✓ Link75.1MiniCPM-V 4.52025-09-16
Qwen2.5-VL Technical Report✓ Link74.6Qwen2.5-VL-72B2025-02-19
Rethinking Long-Video Efficiency: A Joint Allocation Perspective on Frames, Pixels, and Front-End Latency74.38LoHi-SemDiv (Qwen3-VL-4B)2026-10-03
Kimi-VL Technical Report✓ Link74.2Kimi-VL-A3B-Instruct2025-04-10
Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding✓ Link74.0LatentStream (Qwen2.5-VL-7B)2026-09-03
Zoom-Zero: Reinforced Coarse-to-Fine Video Understanding via Temporal Zoom-in✓ Link73.4Zoom-Zero + Divide-and-conquer2025-12-16
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding✓ Link73.0VideoLLaMA3 7B2025-01-22
OmniJigsaw: Enhancing Omni-Modal Reasoning via Modality-Orchestrated Reordering✓ Link72.63OmniJigsaw (SMS)2026-04-09
Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazing✓ Link71.6NVILA-8B-HD-Video2026-03-12
Perceptual Projection Pruning: Diversity-Aware Video Token Pruning for Multimodal Large Language Models71.1P3 (Qwen3-VL-32B, 25% retention)2026-09-08
ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning✓ Link70.8Qwen3-VL-8B + ResAdapt (128 frames, 22.9% retention)2026-03-30
LiteFrame: Efficient Vision Encoders Unlock Frame Scaling in Video LLMs✓ Link70.7LiteFrame2026-05-17
VisReflect: Latent Visual Reflection for Fine-Grained Perception in Long Visual Context✓ Link70.6VisReflect-7B-Video2026-06-29
Unified Spatio-Temporal Token Scoring for Efficient Video VLMs✓ Link70.5Molmo2 (SigLIP2 So400M + Qwen3-4B) with STTS (30%) + Test-Time Scaling (92 frames)2026-03-18
Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition✓ Link70.4Demo-ICL (7B)2026-02-09
MeToM: Metadata-Guided Token Merging for Efficient Video LLMs70.4LLaVA-Video-7B + MeToM2026-06-03
Qwen2.5-VL Technical Report✓ Link70.2Qwen2.5-VL-7B2025-02-19
FlexiVideo: Variation-Aware Temporal Dynamics Modeling for Efficient Video Understanding✓ Link69.6FlexiVideo-3B (extra data)2026-06-03
From Pixels to Words -- Towards Native One-Vision Models at Scale✓ Link69.3NEO-ov 9B2026-05-27
S3-Prune: Stability-Aware Token Budgeting for Long-Form Video-Language Models68.89S3-prune (LLaVA-VID-7B, 25% vision-token retention)2026-09-08
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model✓ Link68.7Mage-VL-4B (tc32)2026-07-27
EVA: Efficient Reinforcement Learning for End-to-End Video Agent✓ Link68.3EVA-GRPO2026-03-24
LLaVA-OneVision: Easy Visual Task Transfer✓ Link68.0LLaVA-OneVision-72B2024-08-06
CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion✓ Link67.9CAt+v (Qwen2.5-VL, 3B)2025-12-22
FutureOmni: Evaluating Future Forecasting from Omni-Modal Context for Multimodal LLMs✓ Link67.86video-SALMONN 2 (7B) +OFF2026-01-20
Training-free Uncertainty Guidance for Complex Visual Tasks with MLLMs✓ Link67.6UG-Sample (InternVL2.5-8B)2025-10-01
Swift Sampling: Selecting Temporal Surprises via Taylor Series67.2Swift Sampling (LLaVA-Video)2026-05-21
Rethinking Chain-of-Thought Reasoning for Videos✓ Link67.0Qwen2.5-VL-7B (GRPO, concise reason, trained with token compression & 6x frames)2025-12-10
LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos✓ Link66.7LENS (Qwen2.5-VL 7B, 32 frames)2026-07-27
TimeViper: A Hybrid Mamba-Transformer Vision-Language Model for Efficient Long Video Understanding✓ Link65.6TimeViper2025-11-20
LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding✓ Link65.4LongVU2024-10-22
H2SVC: Head-aware Heterogeneous Streaming Video Cache for Online Video Understanding65.1LLaVA-OV-7B + H2SVC2026-09-08
Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation✓ Link64.9Intern Lumina U2 (NVIDIA)2026-10-14
Incentivizing Versatile Video Reasoning in MLLMs via Data-Efficient Reinforcement Learning✓ Link64.6VideoReasoner2026-06-03
VideoDetective: Clue Hunting via both Extrinsic Query and Intrinsic Relevance for Long Video Understanding✓ Link63.8VideoDetective (SeedVL-1.5, 20B)2026-03-23
Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone✓ Link61.1Dream-VL2025-12-27
LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning✓ Link59.5LLaDA-V2025-05-22
SmolVLM: Redefining small and efficient multimodal models✓ Link55.2SmolVLM 2.2B2025-04-07
Less Data, Faster Convergence: Goal-Driven Data Optimization for Multimodal Instruction Tuning✓ Link46.89GDO (Temp+)2026-03-12
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs✓ Link45.6VideoLLaMA 2 72B2024-06-11