OpenCodePapers

object-hallucination-evaluation-on-pope

Visual Question Answering (VQA)Object Hallucination Evaluation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeF1ModelNameReleaseDate
ORBIT: Overcoming Hallucination Risks via Bi-manifold Interaction and Traction91.2ORBIT (Qwen2.5-VL-32B)2026-09-08
Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction✓ Link90.8PriorTR (InternVL2.5-8B, 22.2% tokens)2026-06-23
LoopVL: Recurrent Visual Intelligence✓ Link90.71LoopVL-1B2026-09-29
Unlocking Dense Metric Depth Estimation in VLMs✓ Link89.9DepthVLM-4B2026-05-15
MOSS-VL Technical Report✓ Link89.4MOSS-VL-Instruct-07082026-08-15
Envision, Attend, Then Respond: Counterfactual Hallucination Mitigation in Large Vision-Language Models✓ Link89.0EnAR (InternVL3.5-8B)2026-06-03
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs88.72NeuPAT (Qwen3-4B-Instruct-2507) (extra data)2026-08-08
From Pixels to Words -- Towards Native Vision-Language Primitives at Scale✓ Link88.4NEO-9B2025-10-16
Grounded 3D-Aware Spatial Vision-Language Modeling88.23GR3D-8B2026-05-28
LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models✓ Link87.9LLaVA-NeXT-Interleave 14B2024-07-10
MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads✓ Link87.8HEAL (LLaVA-1.5-7B)2026-09-05
LLaVA-NeXT: Improved reasoning, OCR, and world knowledge✓ Link87.73LLaVA-NeXT-34B2024-01-30
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action✓ Link87.7Unified-IO 2 XXL2023-12-28
Boosting Visual Instruction Tuning with Self-Supervised Guidance✓ Link87.7LLaVA-1.5-Qwen2.5-7B + V-GIFT2026-04-14
An AI4AI Framework for Visual Token Pruning87.67AutoPrune (LLaVA-1.5-7B, 32 visual tokens)2026-08-07
VISion On Request: Enhanced VLLM efficiency with sparse, dynamically selected, vision-language interactions87.6VISOR2026-03-24
AnchorPrune: Relevance-Anchored Contextual Expansion for Visual Token Pruning✓ Link87.5LLaVA-NeXT-7B (AnchorPrune, 160 tokens)2026-07-08
ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts✓ Link87.4ViP-LLaVA-13B2023-12-01
Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling✓ Link87.4Janus-Pro-7B2025-01-29
Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models✓ Link87.3Switch-KD 0.5B2026-04-16
ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations✓ Link87.3ARM-7B2026-06-09
MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities✓ Link87.27Modus2026-07-28
Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation✓ Link87.2TRAG (Qwen2.5-1.5B)2026-07-01
Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation✓ Link87.0Janus2024-10-17
Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Large Model Enhancement✓ Link87.0MobileVLM V2 1.7B + Align-KD2024-12-02
LFM2.5-VL-450M: Structured Visual Intelligence, Edge to Cloud86.93LFM2.5-VL-450M2026-04-08
Script: Graph-Structured and Query-Conditioned Semantic Token Pruning for Multimodal Large Language Models✓ Link86.7LLaVA-NeXT-7B with Script2025-12-01
Mixture of Specialized Vision Experts: Unlocking Complementary Visual Insights for Faithful MLLM Reasoning✓ Link86.5MoSVE2026-09-08
Mobile-O: Unified Multimodal Understanding and Generation on Mobile Device✓ Link86.4Mobile-O-0.5B2026-02-23
Online Self-Calibration Against Hallucination in Vision-Language Models86.22LLaVA-1.5-7B (OSCAR)2026-05-01
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone✓ Link86.1Phi-3.5-Vision2024-04-22
VisNec: Measuring and Leveraging Visual Necessity for Multimodal Instruction Tuning✓ Link86.0VisNec (LLaVA-v1.5-7B, LLaVA-665K 15%)2026-03-01
Improved Baselines with Visual Instruction Tuning✓ Link85.9LLaVA-1.5-7B2023-10-05
See Only When Needed: Context-Aware Attention Intervention for Hallucination-Free LVLMs85.8CAI (LLaVA-1.5 7B)2026-09-08
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs✓ Link85.6Phi-4-Multimodal2025-02-24
DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection✓ Link84.91DICS (LLaVA-1.5-7B, 25% LLaVA-665K)2026-08-31
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection✓ Link83.3Video-LLaVA-7B2023-11-16