OpenCodePapers

multi-task-language-understanding-on-mmlu-redux

Natural Language UnderstandingMulti-task Language Understanding
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Qwen3.5: Towards Native Multimodal Agents✓ Link94.9Qwen3.5-397B-A17B2026-02-16
Qwen3.5-Omni Technical Report94.2Qwen3.5-Omni-Plus2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link94.0Qwen3.5-122B-A10B2026-02-16
Introducing efficiency focused "Thinking CAP" model series✓ Link93.9ThinkingCap-Qwen3.6-27B2026-07-06
Qwen3-VL Technical Report✓ Link93.7Qwen3-VL-235B-A22B-Thinking2025-11-26
Qwen3.6✓ Link93.5Qwen3.6-27B2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link93.3Qwen3.5-35B-A3B2026-02-16
Qwen3.6✓ Link93.3Qwen3.6-35B-A3B2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link93.2Qwen3.5-27B2026-02-16
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning✓ Link92.9DeepSeek-R12025-01-22
Qwen3 Technical Report✓ Link92.7Qwen3-235B-A22B (Thinking)2025-05-14
Kimi K2: Open Agentic Intelligence✓ Link92.7Kimi K22025-07-28
EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes✓ Link92.3EXAONE 4.0 32B (Reasoning)2025-07-15
Qwen3-Coder-Next Technical Report✓ Link91.18Qwen3-Coder-Next2026-02-28
Qwen3.5: Towards Native Multimodal Agents✓ Link91.1Qwen3.5-9B2026-02-16
Qwen3-Next90.9Qwen3-Next-80B-A3B-Instruct2025-09-09
On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability✓ Link90.68Qwen3.8-Flash-Next-Base2026-08-31
Qwen3-Omni Technical Report✓ Link89.7Qwen3-Omni-Flash-Thinking2025-09-22
SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture✓ Link89.44SenseNova-U1-A3B-MoT2026-05-12
Qwen3 Technical Report✓ Link89.2Qwen3-235B-A22B (Non-thinking)2025-05-14
DeepSeek-V3 Technical Report✓ Link89.1DeepSeek-V32024-12-27
Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone✓ Link88.05Ternary Bonsai 27B2026-07-14
Qwen2.5 Technical Report✓ Link86.8Qwen2.5-72B-Instruct2024-12-19
Unified Audio Intelligence Without Regressing on Text Intelligence86.4Audex 30B-A3B2026-07-06
SenseNova-U1.5: Towards Native Unified Visual Intelligence✓ Link86.33SenseNova-U1.5 8B-Think2026-09-10
Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation86.3Nemotron-Cascade-2-30B-A3B2026-03-19
Mellum2 Technical Report✓ Link86.2Mellum 2 Thinking2026-05-29
Qwen2.5-VL Technical Report✓ Link85.9Qwen2.5-VL-72B2025-02-19
dots.llm1 Technical Report✓ Link85.1dots.llm1.inst2025-06-06
Data Science and Technology Towards AGI Part I: Tiered Data Management✓ Link84.7MiniCPM5-2B2026-02-09
MiniCPM5-2B✓ Link84.7MiniCPM5-2B2026-09-07
Loop the Loopies!83.61Loopie-20B-A2B (Thinking)2026-07-17
Ministral 382.0Ministral 3 (14B)2026-01-13
Raon-Speech Technical Report✓ Link78.87Raon-Speech2026-04-08
See What I See, Know What I Think: Dense Latent Communication Across Heterogeneous Agents78.57Dense alignment (cross-model KV-cache transformation)2026-06-11
Draft-KV: Learning Useful Latent Communication Between Language Models✓ Link78.04Draft-KV (Qwen3-8B -> Qwen2.5-0.5B-Instruct)2026-09-28
Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision✓ Link76.8Youtu-VL (4B)2026-01-27
Improved Large Language Diffusion Models✓ Link76.4iLLaDA 8B Instruct2026-06-24
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models✓ Link75.8Youtu-LLM 2B2025-12-31
Qwen2.5-Omni Technical Report✓ Link71.0Qwen2.5-Omni-7B2025-03-26
MiniCPM5-1B✓ Link70.06MiniCPM5-1B (Thinking)2026-05-25