OpenCodePapers

vision-language-understanding-on-mmstar

Vision-Language Understanding
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Qwen3.8-Max: A New Bar for Coding and Cowork✓ Link85.9Qwen3.8-Max2026-08-03
ReaGEN: Adaptive Generation of Structured Chains-of-Thought for Efficient Multimodal Reasoning✓ Link84.49ReaGEN (Qwen3-VL-4B, 4 iter)2026-06-03
Qwen3.5: Towards Native Multimodal Agents✓ Link83.8Qwen3.5-397B-A17B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link82.9Qwen3.5-122B-A10B2026-02-16
Masking Teacher and Reinforcing Student for Distilling Vision-Language Models82.0InternVL3 - Masters2025-12-23
Qwen3.5: Towards Native Multimodal Agents✓ Link81.9Qwen3.5-35B-A3B2026-02-16
Qwen3.6✓ Link81.4Qwen3.6-27B2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link81.0Qwen3.5-27B2026-02-16
SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture✓ Link80.92SenseNova-U1-A3B-MoT2026-05-12
Qwen3.6✓ Link80.7Qwen3.6-35B-A3B2026-04-21
HopChain: Multi-Hop Data Synthesis for Generalizable Vision-Language Reasoning80.67Qwen3.5-397B-A17B (RLVR w/ Multi-Hop)2026-03-17
Kwai Keye-VL 1.5 Technical Report✓ Link80.5Keye-VL-1.5-8B2025-09-01
Qwen3.5: Towards Native Multimodal Agents✓ Link79.7Qwen3.5-9B2026-02-16
Qwen3.5-Omni Technical Report79.4Qwen3.5-Omni-Plus2026-04-21
TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models✓ Link79.3Tuna2025-12-01
Qwen3-VL Technical Report✓ Link78.7Qwen3-VL-235B-A22B-Thinking2025-11-26
SpatialASM: Internalizing Active Mentalization for Spatial Reasoning✓ Link78.5SpatialASM-Qwen3.5-9B2026-10-09
STEP3-VL-10B Technical Report✓ Link77.64Step3-VL-10B (PaCoRe)2026-01-14
SenseNova-U1.5: Towards Native Unified Visual Intelligence✓ Link77.53SenseNova-U1.5 8B-Think2026-09-10
See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning✓ Link76.3BiPS (Qwen3-VL-8B-Thinking)2025-12-26
GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning✓ Link75.9GLM-4.6V2025-07-01
Kwai Keye-VL-2.0 Technical Report✓ Link75.9Keye-VL-2.0-30B-A3B2026-06-09
Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving✓ Link75.87Qwen-Drive-1.0-SFT2026-08-31
ERNIE 5.0 Technical Report75.54ERNIE 5.02026-02-04
Kwai Keye-VL Technical Report✓ Link75.5Keye-VL-8B2025-07-02
Qwen3-Omni Technical Report✓ Link75.5Qwen3-Omni-Flash-Thinking2025-09-22
iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning✓ Link75.1iVGR-Qwen3-VL-32B (ours)2026-05-29
EXAONE 4.5 Technical Report✓ Link74.9EXAONE 4.5 (Reasoning)2026-04-09
Context-Aware RL for Agentic and Multimodal LLMs✓ Link74.8ContextRL (trained from Qwen3-VL-8B)2026-06-15
V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoning✓ Link74.4V-Zero-4B (Ours)2026-06-24
OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks✓ Link73.8OpenVLThinkerV2 (Ours)2026-04-09
Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning73.5Scaffolding Encoder+RL2026-09-29
EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience✓ Link73.20EvoCUA-32B2026-01-22
MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction✓ Link73.1MiniCPM-o 4.5-Instruct2026-04-30
From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models✓ Link73.1Qwen3-VL-8B (staged training)2026-05-19
Near-Future Policy Optimization72.63AutoNPO2026-04-22
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models✓ Link72.5InternVL3-78B2025-04-14
Ovis2.5 Technical Report✓ Link72.4Ovis2.5-9B2025-08-15
MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe✓ Link72.1MiniCPM-V 4.52025-09-16
TACO: Tool-Augmented Credit Optimization for Agentic Tool Use72.1TACO (Qwen3-VL-8B, 8B)2026-06-29
Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs✓ Link71.6PVM-8B (SFT+GRPO)2026-05-01
Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation✓ Link71.3JoyAI-Image-Und2026-05-05
SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMs✓ Link71.2SwimBird2026-02-05
Dynamic Important Example Mining for Reinforcement Finetuning✓ Link71.2Qwen2.5-VL-32B + DIEM2026-08-29
Qwen2.5-VL Technical Report✓ Link70.8Qwen2.5-VL-72B2025-02-19
OneThinker: All-in-one Reasoning Model for Image and Video✓ Link70.6OneThinker-8B2025-12-02
Kimi-VL Technical Report✓ Link70.4Kimi-VL-A3B-Thinking-25062025-04-10
VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision70.4VIVAS2026-09-08
Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space✓ Link70.0Qwen3-VL-8B + DMLR2025-12-14
AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution✓ Link69.9AnE-3rd2026-05-25
DeepAlign: Mitigating Modality Conflict through Modality-Specific Alignment69.8DeepAlign (InternVL3-8B)2026-06-03
Infinity-Parser2-Pro69.66Infinity-Parser2-Pro2026-05-11
LongCat-Next: Lexicalizing Modalities as Discrete Tokens✓ Link69.3LongCat-Next (A3B, 68.5B)2026-03-29
Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning✓ Link69.1FactoSR-8B-RL2026-09-03
CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts✓ Link68.9CoLT2026-06-30
MetaphorStar: Image Metaphor Understanding and Reasoning with End-to-End Visual Reinforcement Learning✓ Link68.5MetaphorStar-32B2026-02-11
Semantic Generative Tuning for Unified Multimodal Models✓ Link68.33SGT-BAGEL (7B+7B)2026-05-18
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link68.3Qwen2-VL-72B2024-09-18
UniPath: Adaptive Coordination of Understanding and Generation for Unified Multimodal Reasoning68.07UniPath (BAGEL backbone)2026-05-12
Step-GUI Technical Report✓ Link68.0Step-GUI-8B2025-12-17
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model✓ Link67.32Mage-VL-4B2026-07-27
From Pixels to Words -- Towards Native One-Vision Models at Scale✓ Link67.3NEO-ov 9B2026-05-27
Unlocking Token Rewards via Training-Free Reward Attribution67.2Qwen2.5-VL-7B-Instruct + GRPO (P2T token reward) (extra data)2026-06-03
Robust-U1: Can MLLMs Self-Recover Corrupted Visual Content for Robust Understanding?✓ Link67.20Robust-U12026-06-06
LLaVA-UHD v4: What Makes Efficient Visual Encoding in MLLMs?✓ Link66.9LLaVA-UHD v42026-05-09
SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Traces66.9SpatialOPSD-9B2026-10-08
Toward Cognitive Supersensing in Multimodal Large Language Model✓ Link66.8CogSense-8B2026-02-02
PointThinker: Point-Incentivized Parallel Thinking for Multimodal Large Language Model66.8PointThinker-7B (extra data)2026-06-03
Innovator-VL: A Multimodal Large Language Model for Scientific Discovery✓ Link66.15Innovator-VL (8B-Thinking)2026-01-27
LLaVA-OneVision: Easy Visual Task Transfer✓ Link66.1LLaVA-OneVision-72B2024-08-06
Language-guided Frequency Modulation for Large Vision-Language Models66.1LFM (w/ Qwen2.5-VL)2026-06-03
MOSS-VL Technical Report✓ Link66.0MOSS-VL-Instruct-07082026-08-15
VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus65.88VERDICT2026-08-11
Puzzle Curriculum GRPO for Vision-Centric Reasoning✓ Link65.2Qwen2.5-VL-7B (Mix)2025-12-16
Beyond Layer-Wise Merging: Chain-of-Merging for Vision-Language Models65.0CoM (Qwen2.5-VL-7B + DeepSeek-R1-Distill-Qwen-7B)2026-06-03
LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence✓ Link64.8LLaVA-OneVision-2-8B2026-05-25
Phi-4-reasoning-vision-15B Technical Report✓ Link64.5Phi-4-reasoning-vision-15B2026-03-04
Perceptio: Perception Enhanced Vision Language Models via Spatial Token Generation64.2Perceptio (8B)2026-03-19
From Narrow to Panoramic Vision: Attention-Guided Cold-Start Reshapes Multimodal Reasoning✓ Link64.1AVAR-Thinker2026-03-04
LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model✓ Link64.1LLaDA2.0-Uni (16B)2026-04-22
LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression✓ Link64.1LASER2026-07-02
Qwen2.5-Omni Technical Report✓ Link64.0Qwen2.5-Omni-7B2025-03-26
Qwen2.5-VL Technical Report✓ Link63.9Qwen2.5-VL-7B2025-02-19
Improving Vision-language Models with Perception-centric Process Reward Models✓ Link63.8Qwen2.5-VL (7B) with Perceval2026-04-27
Unlocking Dense Metric Depth Estimation in VLMs✓ Link63.8DepthVLM-8B2026-05-15
OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence✓ Link63.7OpenSpatial-Qwen3-VL-8B2026-04-08
PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models✓ Link63.7PerceptionDLM-Base (8B)2026-06-17
Harnessing Textual Refusal Directions for Multimodal Safety✓ Link63.6MARS (Molmo2 8B)2026-10-16
Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning✓ Link63.5AES+HDC (Qwen3-VL-8B-Instruct)2026-08-06
LoopVL: Recurrent Visual Intelligence✓ Link63.47LoopVL-1B2026-09-29
Reinforcement Learning for Multimodal Diffusion Language Models via Bidimensional Trajectory and Thought Optimization63.2LLaDA-V + Bi-VRL (ours)2026-09-08
Decouple to Generalize: Context-First Self-Evolving Learning for Data-Scarce Vision-Language Reasoning✓ Link63.0DoGe-7B (Iter3)2025-12-07
VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images✓ Link62.7MiMo-VL-7B-SFT + VisionFoundry-10K2026-04-10
SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments✓ Link62.5SpatialEvo (Qwen2.5-VL-7B-Instruct)2026-04-15
From Pixels to Words -- Towards Native Vision-Language Primitives at Scale✓ Link62.4NEO-9B2025-10-16
GGSS: Geodesic-Gated Spherical Steering for Inference-Time Debiasing of Generative Vision-Language Models✓ Link62.1GGSS (Qwen3-VL-4B, gender steering)2026-08-26
Kimi-VL Technical Report✓ Link61.3Kimi-VL-A3B-Instruct2025-04-10
LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents✓ Link61.3LLaDA-UI (pre-training)2026-09-09
HyperVL: An Efficient and Dynamic Multimodal Large Language Model for Edge Devices61.1HyperVL ViTL2025-12-16
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link60.7Qwen2-VL-7B2024-09-18
ROSE: Rotate Your Large Language Model to See60.7ROSE-7B (extra data)2026-06-03
CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Models✓ Link60.67CLEAR-RL (Bagel-7B)2026-04-06
Forest Before Trees: Latent Superposition for Efficient Visual Reasoning✓ Link60.27Laser (Qwen2.5-VL-7B-Instruct)2026-01-11
LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning✓ Link60.1LLaDA-V2025-05-22
Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone✓ Link59.9Dream-VL2025-12-27
Information-Regularized Attention for Visual-Centric Reasoning58.8InternVL2.5-IRA2026-07-01
LFM2 Technical Report✓ Link57.73LFM2-VL-3B2025-11-28
UniDDT: Unifying Multimodal Understanding and Generation with Decoupled Diffusion Transformer57.7VLM-UniDDT2026-06-15
Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding✓ Link56.86Robust-R1 (SFT and RL)2025-12-19
Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to System56.51Native UMM Synergy: Task-decoupled MoT U+G2026-09-01
NGM: A Plug-and-Play Training-Free Memory Module for LLMs✓ Link56.2Qwen3-VL-2B + NGM2026-05-16
Building and better understanding vision-language models: insights and future directions✓ Link55.9Idefics3-8B2024-08-22
InfiniteVL: Synergizing Linear and Sparse Attention for Highly-Efficient, Unlimited-Input Vision-Language Models✓ Link55.6InfiniteVL-Base2025-12-09
UVU: Improving Multimodal Understanding via Vision-Language Unified Autoregressive Paradigm55.0UVU 3B2026-06-03
LaViT: Aligning Latent Visual Thoughts for Multi-modal Reasoning✓ Link54.07LaViT (3B)2026-01-15
PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation✓ Link53.99PixelUMM 8B MoT2026-09-29
Differences That Matter: Auditing Models for Capability Gap Discovery and Rectification52.4Gemma3 + AuditDM2025-12-18
Cheers: Decoupling Patch Details from Semantic Representations Enables Unified Multimodal Comprehension and Generation✓ Link50.9Cheers (1.5B)2026-03-13
Introducing LFM2.5: The Next Generation of On-Device AI50.67LFM2.5-VL-1.6B2026-01-05
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs50.14NeuPAT (Qwen2.5-14B-Instruct) (extra data)2026-08-08
Ovis: Structural Embedding Alignment for Multimodal Large Language Model✓ Link49.5Ovis-Llama3-8B2024-05-31
AutoNeural: Co-Designing Vision-Language Models for NPU Inference49.4AutoNeural2025-12-02
SVR-R1: Bootstrapping Multi-modal Reasoning with Self-verification in Reinforcement Learning49.3SVR-R1 (7B ThinkLite)2026-07-13
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link48.0Qwen2-VL-2B2024-09-18
Preventing Expert Collapse in MoE-dVLMs via Modality-Wise Norm Alignment46.7TowerAlign2026-09-08
SmolVLM: Redefining small and efficient multimodal models✓ Link46.0SmolVLM 2.2B2025-04-07
Boosting Visual Instruction Tuning with Self-Supervised Guidance✓ Link43.2LLaVA-1.5-Qwen2.5-7B + V-GIFT2026-04-14
LFM2.5-VL-450M: Structured Visual Intelligence, Edge to Cloud43.00LFM2.5-VL-450M2026-04-08
GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models✓ Link41.1GeMoE (extra data)2026-06-24
LinguDistill: Recovering Linguistic Ability in Vision- Language Models via Selective Cross-Modal Distillation34.9LinguDistill2026-04-01
SmolDocling: An ultra-compact vision-language model for end-to-end multi-modal document conversion✓ Link17.0SmolDocling2025-03-14