OpenCodePapers

video-question-answering-on-video-mmmu

Video Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Qwen3.8-Max: A New Bar for Coding and Cowork✓ Link88.7Qwen3.8-Max2026-08-03
A new era of intelligence with Gemini 387.6Gemini 3 Pro2025-11-18
dots3-note Preview: A Small but Mighty Step Toward Long-Horizon Agency in Real Life✓ Link86.78dots3-note Preview2026-08-13
Kimi K2.5: Visual Agentic Intelligence✓ Link86.6Kimi K2.52026-02-02
Introducing GPT-5.285.9GPT-5.22025-12-11
Qwen3.5: Towards Native Multimodal Agents✓ Link84.7Qwen3.5-397B-A17B2026-02-16
Qwen3.6✓ Link84.4Qwen3.6-27B2026-04-21
Qwen3.6✓ Link83.7Qwen3.6-35B-A3B2026-04-21
SiLVR: A Simple Language-based Video Reasoning Framework✓ Link82.7SiLVR2025-05-30
Qwen3.5: Towards Native Multimodal Agents✓ Link82.3Qwen3.5-27B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link82.0Qwen3.5-122B-A10B2026-02-16
ERNIE 5.0 Technical Report81.11ERNIE 5.02026-02-04
Qwen3.5: Towards Native Multimodal Agents✓ Link80.4Qwen3.5-35B-A3B2026-02-16
Qwen3-VL Technical Report✓ Link80.0Qwen3-VL-235B-A22B-Thinking2025-11-26
HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning80Qwen3.5-397B-A17B (RLVR w/ Multi-Hop)2026-03-17
Kwai Keye-VL-2.0 Technical Report✓ Link80.0Keye-VL-2.0-30B-A3B2026-06-09
Qwen3.5: Towards Native Multimodal Agents✓ Link78.9Qwen3.5-9B2026-02-16
GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning✓ Link74.7GLM-4.6V2025-07-01
OmniReasoning: Pushing the Limits of Audio-Visual Joint Reasoning✓ Link74.4OmniReasoning-30B-A3B (extra data)2026-09-30
CyberV: Cybernetics for Test-time Scaling in Video Understanding✓ Link74.3Qwen2.5-VL-72B + CyberV2025-06-09
Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoning71.2InternVL3.5-14B + G2F-RAG2026-04-06
Valley3: Scaling Omni Foundation Models for E-commerce68.7Valley3 32B Instruct2026-05-02
SAGE: Training Smart Any-Horizon Agents for Long Video Reasoning with Reinforcement Learning✓ Link68.1SAGE-Flash2025-12-15
LongCat-Flash-Omni Technical Report✓ Link67.5LongCat-Flash-Omni Instruct2025-10-31
OneThinker: All-in-one Reasoning Model for Image and Video✓ Link66.2OneThinker-8B2025-12-02
Kwai Keye-VL 1.5 Technical Report✓ Link66.0Keye-VL-1.5-8B2025-09-01
Kimi-VL Technical Report✓ Link65.2Kimi-VL-A3B-Thinking-25062025-04-10
Qwen2.5-VL Technical Report✓ Link60.2Qwen2.5-VL-72B2025-02-19
ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning✓ Link59.6Qwen3-VL-8B + ResAdapt (128 frames, 22.9% retention)2026-03-30
Kwai Keye-VL Technical Report✓ Link57.6Keye-VL-8B2025-07-02
VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding✓ Link57.4VideoChat3-4B2026-07-16
VIDEOP2R: Video Understanding from Perception to Reasoning55.0VideoP2R2025-11-14
VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting✓ Link54.4VisionCoach-7B2026-03-15
Video-R1: Reinforcing Video Reasoning in MLLMs✓ Link52.7Video-R1-7B (10k RL steps, 32 frames)2025-03-27
Kimi-VL Technical Report✓ Link52.6Kimi-VL-A3B-Instruct2025-04-10
Demo-ICL: In-Context Learning for Procedural Video Knowledge Acquisition✓ Link52.6Demo-ICL (7B)2026-02-09
From Pixels to Words -- Towards Native One-Vision Models at Scale✓ Link51.6NEO-ov 9B2026-05-27
Reinforced Attention Learning49.2RAL-zero2026-02-04
Qwen2.5-VL Technical Report✓ Link47.4Qwen2.5-VL-7B2025-02-19
EventLens: Event-Structure Reinforcement Learning for Video Understanding✓ Link39.6EventLens-8B2026-10-12
CoPE-VideoLM: Codec Primitives For Efficient Video Language Models38.2CoPE 7B2026-02-13