OpenCodePapers

chart-question-answering-on-chartqa

Visual Question Answering (VQA)Chart Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCode1:1 AccuracyModelNameReleaseDate
Ovis2.5 Technical Report✓ Link92.9Ovis2.5-9B2025-08-15
DoCoG: Mask-based Multi-Type Grounded Chain-of-Thought for Document QA92.7DoCoG (Ours)2026-09-08
Twin-T & TwintVQA: A Reliable Structure-Detail Separating VLM and a Comprehensive Benchmark for Chart and Table Tasks✓ Link91.88Twin-T-7B2026-06-03
MiniMax-01: Scaling Foundation Models with Lightning Attention✓ Link91.7MiniMax-VL-012025-01-14
Vero: An Open RL Recipe for General Visual Reasoning✓ Link91.6Vero-Qwen3I-8B2026-04-06
PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models✓ Link91.6PerceptionDLM-Base2026-06-17
Introducing Command A Vision: Multimodal AI built for business90.9Command A Vision2025-07-31
Introducing Claude 3.5 Sonnet90.8Claude 3.5 Sonnet2024-06-20
iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning✓ Link90.4iVGR-Qwen3-VL-32B (ours)2026-05-29
Qwen3-VL Technical Report✓ Link90.3Qwen3-VL-235B-A22B-Thinking2025-11-26
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence✓ Link90.3Nemotron 3 Nano Omni (Reasoning)2026-04-27
The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation✓ Link90.0Llama 4 Maverick2025-04-05
NVIDIA Nemotron Nano V2 VL✓ Link89.8Nemotron Nano V2 VL (Reasoning off) (extra data)2025-11-06
InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models✓ Link89.7InternVL3-78B2025-04-14
Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders✓ Link89.6Penguin-VL 8B2026-03-06
Qwen2.5-VL Technical Report✓ Link89.5Qwen2.5-VL-72B2025-02-19
Qwen3-Omni Technical Report✓ Link89.3Qwen3-Omni-Flash-Thinking2025-09-22
Language-guided Frequency Modulation for Large Vision-Language Models89.2LFM (w/ Qwen2.5-VL)2026-06-03
SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMs✓ Link89.0SPOT-E (Qwen3-VL-8B)2026-06-18
The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation✓ Link88.8Llama 4 Scout2025-04-05
START: Spatial and Textual Learning for Chart Understanding✓ Link88.8START-RL2025-12-08
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link88.3Qwen2-VL-72B2024-09-18
Skill-Decoupled On-Policy Expert Distillation for Unified Vision-Language Models✓ Link88.28SCOPED-8B (extra data)2026-10-15
Qianfan-OCR: A Unified End-to-End Model for Document Intelligence✓ Link88.1Qianfan-OCR2026-03-11
LongCat-Next: Lexicalizing Modalities as Discrete Tokens✓ Link88.0LongCat-Next (A3B, 68.5B)2026-03-29
ERNIE 5.0 Technical Report87.8ERNIE 5.02026-02-04
MMVistaReason: Toward Open-Data and Post-Training Recipes for Multimodal Reasoning✓ Link87.6MMVistaReason-9B2026-10-22
MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe✓ Link87.4MiniCPM-V 4.52025-09-16
OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks✓ Link87.4OpenVLThinkerV2 (Ours)2026-04-09
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models✓ Link87.3Molmo 72B2024-09-25
Qwen2.5-VL Technical Report✓ Link87.3Qwen2.5-VL-7B2025-02-19
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context✓ Link87.2Gemini 1.5 Pro2024-03-08
ERNIE 4.5 Technical Report✓ Link86.8ERNIE-4.5-VL-424B-A47B2025-06-30
Innovator-VL: A Multimodal Large Language Model for Scientific Discovery✓ Link86.8Innovator-VL (8B-Instruct)2026-01-27
TACO: Tool-Augmented Credit Optimization for Agentic Tool Use86.7TACO (Qwen2.5-VL-7B, 7B)2026-06-29
ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning✓ Link86.6Qwen2.5-VL-7B + ResAdapt-RL (zero-shot, 105% retention)2026-03-30
Phrase-Grounding-Aware Supervised Fine-Tuning for Chart Recognition via Side-Masked Attention✓ Link86.5PGA-SFT (Qwen2.5-VL-7B)2026-06-03
Improving Vision-language Models with Perception-centric Process Reward Models✓ Link86.48Qwen2.5-VL (3B) with Perceval2026-04-27
Aria: An Open Multimodal Native Mixture-of-Experts Model✓ Link86.4Aria2024-10-08
Reinforced Attention Learning86.4RAL2026-02-04
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding✓ Link86.3VideoLLaMA3 7B2025-01-22
Kwai Keye-VL Technical Report✓ Link86.3Keye-VL-8B2025-07-02
FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution✓ Link86.28FocusVTC2026-09-29
From Pixels to Words -- Towards Native One-Vision Models at Scale✓ Link86.2NEO-ov 9B2026-05-27
Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation✓ Link86.2Intern Lumina U2 (NVIDIA)2026-10-14
Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Grounding✓ Link86.1Molmo2-4B2026-01-15
Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models86.1Insight-V++2026-03-18
LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence✓ Link85.9LLaVA-OneVision-2-8B2026-05-25
The Llama 3 Herd of Models✓ Link85.8Llama 3-V (405B)2024-07-31
Hello GPT-4o85.7GPT-4o2024-05-13
Llama 3.2: Revolutionizing edge AI and vision with open, customizable models✓ Link85.5Llama 3.2 90B Vision Instruct2024-09-25
PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding✓ Link85.5PLM-8B2025-04-17
Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs85.42Qwen3-VL-4B + PatternRL2026-08-17
Paying More Attention to Visual Tokens in Self-Evolving Large Multimodal Models✓ Link85.41VISE (Qwen3-VL-8B)2026-06-25
Qwen2.5-Omni Technical Report✓ Link85.3Qwen2.5-Omni-7B2025-03-26
FastVLM: Efficient Vision Encoding for Vision Language Models✓ Link85.0FastVLM-7B2024-12-17
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model✓ Link84.88Mage-VL-4B2026-07-27
LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents✓ Link84.8LLaDA-UI (pre-training)2026-09-09
Toward Cognitive Supersensing in Multimodal Large Language Model✓ Link84.7CogSense-8B2026-02-02
Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone✓ Link84.5Dream-VL2025-12-27
DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models✓ Link84.2DiffusionVL2025-12-17
M3Grounder: Mask-Based Multi-Span and Multi-Granular Grounding for Document QA83.9M3Grounder-Q2026-06-03
Can Discrete Tokens Serve as Semantically Lossless Representations of Visual Signals?✓ Link83.9FVQ (8B)2026-10-27
LLaVA-OneVision: Easy Visual Task Transfer✓ Link83.7LLaVA-OneVision-72B2024-08-06
Phi-4-reasoning-vision-15B Technical Report✓ Link83.3Phi-4-reasoning-vision-15B2026-03-04
Multimodal OCR: Parse Anything from Documents✓ Link83.2dots.mocr2026-03-13
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link83.0Qwen2-VL-7B2024-09-18
Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models✓ Link83.0Embodied-R1.52026-06-09
PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation✓ Link82.96PixelUMM 8B MoT2026-09-29
NaVLM-PVC: Progressive Visual Compression for Efficient Native-Resolution Encoding in MLLMs82.8NaVLM-PVC2026-09-08
Structure-Token Evidence-Anchored Reasoning for Scientific Chart Understanding82.70STEER2026-09-07
MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities✓ Link82.45Modus2026-07-28
ROSE: Rotate Your Large Language Model to See82.4ROSE-7B (extra data)2026-06-03
ZAYA1-VL-8B Technical Report✓ Link82.2ZAYA1-VL-8B2026-05-08
From Pixels to Words -- Towards Native Vision-Language Primitives at Scale✓ Link82.1NEO-9B2025-10-16
InfiniteVL: Synergizing Linear and Sparse Attention for Highly-Efficient, Unlimited-Input Vision-Language Models✓ Link82.0InfiniteVL-4B (extra data)2025-12-09
Sparse-LaViDa: Sparse Multimodal Discrete Diffusion Language Models82.0Sparse-LaViDa2025-12-16
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone✓ Link81.8Phi-3.5-Vision2024-04-22
Pixtral 12B✓ Link81.8Pixtral 12B2024-10-09
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs✓ Link81.4Phi-4-Multimodal2025-02-24
Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs81.3ChartPaLI-5B + PaLM 2-S2024-03-19
CASA: Cross-Attention via Self-Attention for Efficient Vision-Language Fusion✓ Link81.3CAt+v (Qwen2.5-VL, 3B)2025-12-22
Representation Forcing for Bottleneck-Free Unified Multimodal Models81.3Pixel+RF2026-05-29
Grounded 3D-Aware Spatial Vision-Language Modeling81.01GR3D-8B2026-05-28
Gemini: A Family of Highly Capable Multimodal Models✓ Link80.8Gemini Ultra2023-12-19
MoE-ViE: Mixture of Experts Vision Encoder for Efficient Image and Video Understanding✓ Link80.8MoE-ViE-H/14 + Llama 3.1 8B (42M alignment)2026-08-18
Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs✓ Link80.64AwaRes2026-03-14
LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model✓ Link80.1LLaDA2.0-Uni (16B)2026-04-22
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding✓ Link79.8VideoLLaMA3 2B2025-01-22
DePlot: One-shot visual language reasoning by plot-to-table translation✓ Link79.3DePlot+FlanPaLM+Codex (PoT Self-Consistency)2022-12-20
LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model✓ Link79.3LLaDA-o2026-03-01
ProLaViT: Learning Progressive Latent Visual Thoughts in Structured Latent Space✓ Link78.99ProLaViT (Full)2026-07-03
GPT-4 Technical Report✓ Link78.5GPT-4 (vision, 4-shot CoT)2023-03-15
Gemma 3 Technical Report✓ Link78.0Gemma 3 (27B, IT) (4-shot)2025-03-25
Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs77.3ChartPaLI-5B2024-03-19
Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders✓ Link76.9Penguin-VL 2B2026-03-06
DePlot: One-shot visual language reasoning by plot-to-table translation✓ Link76.7DePlot+Codex (PoT Self-Consistency)2022-12-20
ScreenAI: A Vision-Language Model for UI and Infographics Understanding✓ Link76.7ScreenAI 5B (4.62 B params, w/ OCR)2024-02-07
InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing✓ Link76.6InternVL-U (4B)2026-03-10
Mini-Monkey: Alleviating the Semantic Sawtooth Effect for Lightweight MLLMs via Complementary Image Pyramid✓ Link76.5Mini-Monkey (extra data)2024-08-04
AdaptVision: Efficient Vision-Language Models via Adaptive Visual Acquisition✓ Link75.92AdaptVision (Qwen2.5-VL-7B-Instruct)2025-12-03
Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification✓ Link75.9UniAR2026-06-16
Cheers: Decoupling Patch Details from Semantic Representations Enables Unified Multimodal Comprehension and Generation✓ Link75.7Cheers (1.5B)2026-03-13
Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device✓ Link75.2Mobile-O-0.5B2026-02-23
T5Gemma 2: Seeing, Reading, and Understanding Longer75.0T5Gemma 2 4B-4B (post-trained)2025-12-16
CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts✓ Link74.7CoLT2026-06-30
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts74.6SMoLA-PaLI-X Specialist Model2023-12-01
LoopVL: Recurrent Visual Intelligence✓ Link74.52LoopVL-1B2026-09-29
TUNA: Taming Unified Visual Representations for Native Unified Multimodal Models✓ Link74.3Tuna2025-12-01
Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Experts73.8SMoLA-PaLI-X Generalist Model2023-12-01
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution✓ Link73.5Qwen2-VL-2B2024-09-18
Synthesize Step-by-Step: Tools Templates and LLMs as Data Generators for Reasoning-Based Chart VQA72.64MatCha4096 + LaMenDa2024-01-01
Non-Natural Image Understanding with Advancing Frequency-based Vision Encoders72.5EDGE (extra data)2025-06-11
PaLI-X: On Scaling up a Multilingual Vision and Language Model✓ Link72.3PaLI-X (Single-task FT w/ OCR)2023-05-29
LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models✓ Link71.2LLaVA-NeXT-Interleave 14B2024-07-10
PaLI-X: On Scaling up a Multilingual Vision and Language Model✓ Link70.9PaLI-X (Single-task FT)2023-05-29
PaLI-X: On Scaling up a Multilingual Vision and Language Model✓ Link70.6PaLI-X (Multi-task FT)2023-05-29
DePlot: One-shot visual language reasoning by plot-to-table translation✓ Link70.5DePlot+FlanPaLM (Self-Consistency)2022-12-20
mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding✓ Link70.5DocOwl 1.5 (extra data)2024-03-19
PaLI-3 Vision Language Models: Smaller, Faster, Stronger✓ Link70PaLI-32023-10-13
mPLUG-DocOwl2: High-resolution Compressing for OCR-free Multi-page Document Understanding✓ Link70.0DocOwl22024-09-05
PaLI-3 Vision Language Models: Smaller, Faster, Stronger✓ Link69.5PaLI-3 (w/ OCR)2023-10-13
SmolVLM: Redefining small and efficient multimodal models✓ Link68.7SmolVLM 2.2B2025-04-07
Emu3: Next-Token Prediction is All You Need✓ Link68.6Emu3 (extra data)2024-09-27
DePlot: One-shot visual language reasoning by plot-to-table translation✓ Link67.3DePlot+FlanPaLM (CoT)2022-12-20
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond✓ Link66.3Qwen-VL-Chat2023-08-24
UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning✓ Link66.24UniChart2023-05-24
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond✓ Link65.7Qwen-VL2023-08-24
StructChart: On the Schema, Metric, and Augmentation for Visual Chart Understanding✓ Link65.3StructChart+GPT3.5 (STR ChartQA+SimChart9K)2023-09-20
VISion On Request: Enhanced VLLM efficiency with sparse, dynamically selected, vision-language interactions65.2VISOR2026-03-24
MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering✓ Link64.2MatCha2022-12-19
KOSMOS-2.5: A Multimodal Literate Model✓ Link62.3Kosmos-2.5-chat2023-09-20
StructChart: On the Schema, Metric, and Augmentation for Visual Chart Understanding✓ Link60.7StructChart+GPT3.5 (STR)2023-09-20
Preventing Expert Collapse in MoE-dVLMs via Modality-Wise Norm Alignment59.0TowerAlign2026-09-08
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding✓ Link58.6Pix2Struct-large2022-10-07
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding✓ Link57.4mPLUG-DocOwl (extra data)2023-07-04
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding✓ Link56.0Pix2Struct-base2022-10-07
ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning✓ Link45.5VisionTapas-OCR2022-03-19
DePlot: One-shot visual language reasoning by plot-to-table translation✓ Link42.3DePlot+GPT3 (Self-Consistency)2022-12-20
DePlot: One-shot visual language reasoning by plot-to-table translation✓ Link36.9DePlot+GPT3 (CoT)2022-12-20
Rethinking Projector Training in Multimodal LLMs✓ Link17.9PORTAL (Vicuna 1.5 7B + SigLIP)2026-10-13