OpenCodePapers

audio-visual-question-answering-on-worldsense

Audio Question AnsweringAudio-visual Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Qwen3.5-Omni Technical Report62.8Qwen3.5-Omni-Plus2026-04-21
OmniSeek: Native Tool Integration for Multi-turn Audio-Visual Reasoning62.4OmniSeek (ours)2026-10-01
OmniAgent: Audio-Guided Active Perception Agent for Omnimodal Audio-Video Understanding✓ Link61.2OmniAgent2025-12-29
LongCat-Flash-Omni Technical Report✓ Link60.89LongCat-Flash-Omni Instruct2025-10-31
Omni-Decision: Evidence-Ledger Planning for Omni-Modal Agents58.32Omni-Decision2026-09-24
MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction✓ Link55.7MiniCPM-o 4.5-Instruct2026-04-30
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence✓ Link55.4Nemotron 3 Nano Omni (Reasoning)2026-04-27
Qwen3-Omni Technical Report✓ Link54.0Qwen3-Omni-30B-A3B-Instruct2025-09-22
Realtime-Venus: A full-duplex interaction system with asynchronous delegation54Realtime-Venus-Omni2026-09-12
CogniRoute: Learning to Route Social Evidence in Omni-Modal Models53.8CogniRoute2026-06-18
Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos51.6AVF-Think2026-07-17
When Vision Speaks for Sound✓ Link50.3Qwen3-Omni-30B + Thud2026-05-13
Omni Interaction Agent Technical Report✓ Link49.62Gander2026-09-08
OmniCap-IF: Benchmarking and Improving Instruction Following Abilities for Omni-Video Captioning✓ Link49.4OmniCaptioner-IF-7B2026-06-07
LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning✓ Link48.9LatentOmni2026-05-21
FutureOmni: Evaluating Future Forecasting from Omni-Modal Context for Multimodal LLMs✓ Link48.77video-SALMONN 2 (7B) +OFF2026-01-20
OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM✓ Link48.23OmniVinci2025-10-17
ChronusOmni: Improving Time Awareness of Omni-Modal Large Language Models47.8ChronusOmni2026-09-08
Native Active Perception as Reasoning for Omni-Modal Understanding✓ Link47.2OmniAgent-RL-7B2026-06-17
HumanOmniV2: From Understanding to Omni-Modal Reasoning with Context✓ Link47.1HumanOmniV2-7B2025-06-26
Open-o3-Video-v2: Seek, Ground, and Reason with Verifiable Spatio-Temporal Evidence✓ Link46.3Open-o3-Video-v2-4B2026-10-13
Omni-Modal LLMs Know More Than They Say45.7OMNI-CATALYST (Qwen2.5-Omni-7B)2026-10-12
Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data✓ Link44.7Uni-MoE-2.0-Omni2025-11-16
VisionCoach: Reinforcing Grounded Video Reasoning via Visual-Perception Prompting✓ Link43.8VisionCoach-7B2026-03-15
MAD: Modality-Adaptive Decoding for Mitigating Cross-Modal Hallucinations in Multimodal Large Language Models✓ Link25.6VideoLLaMA2-AV + MAD2026-01-29