OpenCodePapers

visual-question-answering-vqa-on-realworldqa

Visual Question Answering (VQA)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability✓ Link88.5Qwen3.8-Flash-Next2026-08-31
Qwen3.8-Max: A New Bar for Coding and Cowork✓ Link88.0Qwen3.8-Max2026-08-03
Qwen3.8-27B✓ Link85.9Qwen3.8-27B2026-08-05
Qwen3.6✓ Link85.3Qwen3.6-35B-A3B2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link85.1Qwen3.5-122B-A10B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link84.1Qwen3.5-35B-A3B2026-02-16
Qwen3.5-Omni Technical Report84.1Qwen3.5-Omni-Plus2026-04-21
Qwen3.6✓ Link84.1Qwen3.6-27B2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link83.9Qwen3.5-397B-A17B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link83.7Qwen3.5-27B2026-02-16
Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence83.4Capek0.5-35B-A3B2026-08-07
Introducing efficiency focused "Thinking CAP" model series✓ Link81.9ThinkingCap-Qwen3.6-27B2026-07-06
HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning81.7Qwen3.5-397B-A17B (RLVR w/ Multi-Hop)2026-03-17
SpatialASM: Internalizing Active Mentalization for Spatial Reasoning✓ Link81.7SpatialASM-Qwen3.5-9B2026-10-09
Qwen3-VL Technical Report✓ Link81.3Qwen3-VL-235B-A22B-Thinking2025-11-26
Qwen3.5: Towards Native Multimodal Agents✓ Link80.3Qwen3.5-9B2026-02-16
Cosmos 3: Omnimodal World Models for Physical AI✓ Link79.2Cosmos3-Super2026-06-01
Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving✓ Link78.95Qwen-Drive-1.0-SFT2026-08-31
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models✓ Link78.0InternVL3-78B2025-04-14
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link77.8Qwen2-VL-72B2024-09-18
Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding✓ Link77.6Molmo2-8B2026-01-15
iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning✓ Link76.3iVGR-Qwen3-VL-32B (ours)2026-05-29
LongCat-Flash-Omni Technical Report✓ Link76.0LongCat-Flash-Omni2025-10-31
SenseNova-U1.5: Towards Native Unified Visual Intelligence✓ Link75.8SenseNova-U1.5-8B-MoT2026-09-10
Qwen2.5-VL Technical Report✓ Link75.7Qwen2.5-VL-72B2025-02-19
STEP3-VL-10B Technical Report✓ Link75.56Step3-VL-10B (PaCoRe)2026-01-14
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models✓ Link75.2Molmo 72B2024-09-25
PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding✓ Link75.0PLM-8B2025-04-17
TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models✓ Link74.7Tuna2025-12-01
Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision✓ Link74.6Youtu-VL (4B)2026-01-27
From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models✓ Link74.5Qwen3-VL-8B (staged training)2026-05-19
Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation✓ Link74.0JoyAI-Image-Und2026-05-05
PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models✓ Link73.7PerceptionDLM-Base (8B)2026-06-17
Introducing Command A Vision: Multimodal AI built for business73.6Command A Vision2025-07-31
Kwai Keye-VL 1.5 Technical Report✓ Link73.5Keye-VL-1.5-8B2025-09-01
vLLM Semantic Router: Signal Driven Decision Routing for Mixture-of-Modality Models✓ Link73.4d32026-02-23
Vero: An Open RL Recipe for General Visual Reasoning✓ Link73.3Vero-Qwen3I-8B2026-04-06
ERNIE 4.5 Technical Report✓ Link73.2ERNIE-4.5-VL-424B-A47B2025-06-30
SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMs✓ Link73.1SwimBird2026-02-05
Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?✓ Link72.81Robust-U12026-06-06
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding✓ Link72.7VideoLLaMA3 7B2025-01-22
MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe✓ Link72.1MiniCPM-V 4.52025-09-16
LongCat-Next: Lexicalizing Modalities as Discrete Tokens✓ Link72.0LongCat-Next (A3B, 68.5B)2026-03-29
LLaVA-OneVision: Easy Visual Task Transfer✓ Link71.9LLaVA-OneVision-72B2024-08-06
Learning from Primitive: Probing Visual Reasoning of LVLMs via Counting71.83Qwen3-VL-8B (Learning from Primitive) (extra data)2026-09-08
DeepAlign: Mitigating Modality Conflict through Modality-Specific Alignment71.6DeepAlign (InternVL3-8B)2026-06-03
Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning✓ Link71.6FactoSR-8B-RL2026-09-03
Innovator-VL: A Multimodal Large Language Model for Scientific Discovery✓ Link71.5Innovator-VL (8B-Instruct)2026-01-27
Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders✓ Link71.5Penguin-VL 8B2026-03-06
LFM2 Technical Report✓ Link71.37LFM2-VL-3B2025-11-28
Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding✓ Link71.2VL-Rethinker-7B with LEAD2026-03-09
Odysseus: Scaling VLMs to 100+ Turn Decision-Making in Games via Reinforcement Learning71.11Odysseus (RL on SFT)2026-05-01
ClaimDiff-RL: Fine-Grained Caption Reinforcement Learning through Visual Claim Comparison✓ Link71.1ClaimDiff-RL (actor-only) (init: Qwen3VL-32B-Instruct)2026-05-19
OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence✓ Link71.0OpenSpatial-Qwen3-VL-8B2026-04-08
LoopVL: Recurrent Visual Intelligence✓ Link70.98LoopVL-1B2026-09-29
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context✓ Link70.4Gemini 1.5 Pro2024-03-08
Qwen2.5-Omni Technical Report✓ Link70.3Qwen2.5-Omni-7B2025-03-26
Generation as Auxiliary Supervision: Enhancing Visual Understanding at Zero Inference Overhead via Decoupled Embedding Prediction70.3GAS (4B)2026-08-12
NaVLM-PVC: Progressive Visual Compression for Efficient Native-Resolution Encoding in MLLMs70.3NaVLM-PVC2026-09-08
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link70.1Qwen2-VL-7B2024-09-18
Kimi-VL Technical Report✓ Link70.0Kimi-VL-A3B-Thinking-25062025-04-10
LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence✓ Link69.7LLaVA-OneVision-2-8B2026-05-25
BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset✓ Link69.0BLIP3-o (8B)2025-05-14
Grok-1.5 Vision Preview68.7Grok-1.5V2024-04-12
Qwen2.5-VL Technical Report✓ Link68.5Qwen2.5-VL-7B2025-02-19
Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs✓ Link68.5AwaRes2026-03-14
ROSE: Rotate Your Large Language Model to See68.2ROSE-7B (extra data)2026-06-03
Kimi-VL Technical Report✓ Link68.1Kimi-VL-A3B-Instruct2025-04-10
DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models✓ Link68.0DiffusionVL2025-12-17
MOSS-VL Technical Report✓ Link68.0MOSS-VL-Instruct-07082026-08-15
From Pixels to Words -- Towards Native One-Vision Models at Scale✓ Link67.8NEO-ov 9B2026-05-27
Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding✓ Link67.71Robust-R1 (SFT and RL)2025-12-19
Starve to Perceive: Taming Lazy Perception in VLMs with Constrained Visual Bandwidth67.71Starve to Perceive2026-05-18
Kwai Keye-VL Technical Report✓ Link67.7Keye-VL-8B2025-07-02
Faithful GRPO: Improving Visual Spatial Reasoning in Multimodal Language Models via Constrained Policy Optimization67.64FGRPO (7B)2026-04-09
VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images✓ Link67.5MiMo-VL-7B-SFT + VisionFoundry-10K2026-04-10
AdaptVision: Efficient Vision-Language Models via Adaptive Visual Acquisition✓ Link67.32AdaptVision (Qwen2.5-VL-7B-Instruct)2025-12-03
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding✓ Link67.3VideoLLaMA3 2B2025-01-22
InfiniteVL: Synergizing Linear and Sparse Attention for Highly-Efficient, Unlimited-Input Vision-Language Models✓ Link67.3InfiniteVL-Base2025-12-09
FastVLM: Efficient Vision Encoding for Vision Language Models✓ Link67.2FastVLM-7B2024-12-17
SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments✓ Link66.7SpatialEvo (Qwen2.5-VL-7B-Instruct)2026-04-15
LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model✓ Link66.7LLaDA2.0-Uni (16B)2026-04-22
Representation Forcing for Bottleneck-Free Unified Multimodal Models66.6VAE+RF2026-05-29
Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone✓ Link66.3Dream-VL2025-12-27
Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation✓ Link66.01OpenUni-3.6B + UniMRG2026-01-29
ZAYA1-VL-8B Technical Report✓ Link65.0ZAYA1-VL-8B2026-05-08
Introducing LFM2.5: The Next Generation of On-Device AI64.84LFM2.5-VL-1.6B2026-01-05
Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders✓ Link63.9Penguin-VL 2B2026-03-06
CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion✓ Link63.8CAt+v (Qwen2.5-VL, 3B)2025-12-22
MiniCPM-V: A GPT-4V Level MLLM on Your Phone✓ Link63.5MiniCPM-Llama3-V 2.52024-08-03
LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents✓ Link63.5LLaDA-UI (pre-training)2026-09-09
LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning✓ Link63.2LLaDA-V2025-05-22
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link62.9Qwen2-VL-2B2024-09-18
Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation✓ Link62.9Intern Lumina U2 (Ascend)2026-10-14
Ovis: Structural Embedding Alignment for Multimodal Large Language Model✓ Link62.7Ovis-Qwen1.5-14B2024-05-31
Falcon2-11B Technical Report61.7Falcon2-11B VLM2024-07-20
Differences That Matter: Auditing Models for Capability Gap Discovery and Rectification61.4Gemma3 + AuditDM2025-12-18
CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Models✓ Link61.05CLEAR-RL (Bagel-7B)2026-04-06
Cheers: Decoupling Patch Details from Semantic Representations Enables Unified Multimodal Comprehension and Generation✓ Link60.9Cheers (1.5B)2026-03-13
Qwen-3D: A Generalist 3D Vision-Language Model for Spatial Understanding✓ Link60.4Qwen-3D-3B2026-08-04
GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models✓ Link60.1GeMoE (extra data)2026-06-24
Preventing Expert Collapse in MoE-dVLMs via Modality-Wise Norm Alignment58.9TowerAlign2026-09-08
LFM2.5-VL-450M: Structured Visual Intelligence, Edge to Cloud58.43LFM2.5-VL-450M2026-04-08
MIRROR: Aligning Semantic Relations from Language to Image via Gromov--Wasserstein57.7LLaVA-NeXT-7B + MIRROR2026-06-28
Emu3: Next-Token Prediction is All You Need✓ Link57.4Emu32024-09-27
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs56.99NeuPAT (Qwen3-4B-Instruct-2507) (extra data)2026-08-08
Rethinking Projector Training in Multimodal LLMs✓ Link56.9PORTAL (LLaMA 3.1 8B + CLIP)2026-10-13
VISion On Request: Enhanced VLLM efficiency with sparse, dynamically selected, vision-language interactions54.6VISOR2026-03-24
ESC: Emotional Self-Correction for Reliable Vision-Language Models✓ Link54.51ESC + Qwen2-VL-7B2026-07-01
SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language54.2Spatial-LLaVA-7B (extra data)2025-06-11
LinguDistill: Recovering Linguistic Ability in Vision- Language Models via Selective Cross-Modal Distillation49.0LinguDistill2026-04-01
Modality Gap-Driven Subspace Alignment Training Paradigm For Multimodal Large Language Models✓ Link47.97ReVision2026-02-02
Unfold The World: Factorize 4D Properties in Reinforcing Spatial Understanding47.3FactoSR-8B-RL2026-09-08
T5Gemma 2: Seeing, Reading, and Understanding Longer46.1T5Gemma 2 4B-4B2025-12-16