OpenCodePapers

3d-question-answering-3d-qa-on-sqa3d

Visual Question Answering (VQA)3D Question Answering (3D-QA)
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeExact MatchModelNameReleaseDate
3D-SceneQ: Empowering 3D LLM With Query-Guided Adaptive Pruning and Multi-Modal Feature Enhancement67.03D-SceneQ2026-10-27
Modeling Cross-vision Synergy for Unified Large Vision Model64.8PolyV2026-03-03
Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models✓ Link63.9GeoVR-4B2026-06-04
Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering63.8Imagine3D-LLM2026-09-29
CVP: Central-Peripheral Vision-Inspired Multimodal Model for Spatial Reasoning62.3CVP2025-12-09
3D Aware Region Prompted Vision Language Model62.2SR-3D-8B2025-09-16
Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models✓ Link61.4GeoVR-2B2026-06-04
Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding✓ Link61.3VEGA-3D2026-03-19
SpaceMind: Camera-Guided Modality Fusion for Spatial Reasoning in Vision-Language Models61.1SpaceMind2025-11-28
V-LynX: Token Interface Alignment for Video+X LLMs✓ Link60.5V-LynX-7B2026-05-30
Vision-Language Memory for Spatial Reasoning60.4VLM2-7B2025-11-25
LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness60.1LLaVA-3D2024-09-26
Reasoning in Space via Grounding in the World✓ Link59.9GS-Reasoner2025-10-15
Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understanding✓ Link58.6Video-3D LLM2024-11-30
Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs✓ Link58.6APEIRIA2026-05-31
CAIRN: Cross-Room 3D Scene Understanding with Topology-Aware Large Multimodal Models58.1CAIRN2026-07-07
C^2ROPE: Causal Continuous Rotary Positional Encoding for 3D Large Multimodal-Models Reasoning56.8C^2ROPE2026-02-11
Qwen-3D: A Generalist 3D Vision-Language Model for Spatial Understanding56.8Qwen-3D (7B)2026-08-04
CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models✓ Link56.3CAPruner + Llama-3-8B2026-04-21
MoE3D: Mixture of Experts meets Multi-Modal 3D Understanding56.0MoE3D2025-11-27
Qwen-3D: A Generalist 3D Vision-Language Model for Spatial Understanding55.8Qwen-3D (3B)2026-08-04
Descrip3D: Enhancing Large Language Model-based 3D Scene Understanding with Object-Level Text Descriptions55.7Descrip3D (Vicuna-7B)2025-07-19
SceneScaffold: Active Scene-State Construction for Unified 3D Scene Understanding✓ Link55.5SceneScaffold2026-09-27
Scalable Object Relation Encoding for Better 3D Spatial Reasoning in Large Language Models✓ Link55.23DGraphLLM-7B + QuatRoPE2026-03-25
Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers✓ Link54.7Chat-3D v22023-12-13
Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers✓ Link54.6ChatScene2023-12-13
PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding54.6PAR3D2026-06-04
Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning54.2Scene-LLM2024-03-18
Scalable Object Relation Encoding for Better 3D Spatial Reasoning in Large Language Models✓ Link53.23DGraphLLM-1B + QuatRoPE2026-03-25
CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models✓ Link52.8CAPruner + Llama-3.2-1B2026-04-21
POMA-3D: The Point Map Way to 3D Scene Understanding51.1POMA-3D (spec)2025-11-20
An Embodied Generalist Agent in 3D World✓ Link50.0LEO2023-11-18
Memory Tree Guided Key Frame Querying for Efficient 3D Question Answering✓ Link49.6MemTree3D (w/ LLaVA-OneVision-7B)2026-08-18
Scene-R1: Video-Grounded Large Language Models for 3D Scene Reasoning without 3D Annotations49.4Scene-R12025-06-21
3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment✓ Link48.53D-VisTA2023-08-08
Video Instruction Tuning With Synthetic Data48.5LLaVA-Video2024-10-03
ScanQA: 3D Question Answering for Spatial Scene Understanding✓ Link47.2ScanQA2021-12-20
Unifying 3D Vision-Language Understanding via Promptable Queries47.1PQ3D2024-05-19
Scan2Cap: Context-aware Dense Captioning in RGB-D Scans41.0Scan2Cap2020-12-03
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark✓ Link37.3VideoChat22023-11-28
LLaVA-OneVision: Easy Visual Task Transfer✓ Link34.2LLaVA-NeXT-Video2024-08-06