OpenCodePapers

multi-task-language-understanding-on-mmmlu

Natural Language UnderstandingMulti-task Language Understanding
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Gemini 3.1 Pro: A smarter model for your most complex tasks92.6Gemini 3.1 Pro2026-02-19
Introducing GPT-5.289.6GPT-5.22025-12-11
Claude Opus 4.189.5Claude Opus 4.12025-08-05
Qwen3.5: Towards Native Multimodal Agents✓ Link88.5Qwen3.5-397B-A17B2026-02-16
Gemma 4 Technical Report✓ Link88.4Gemma 4 31B2026-07-02
Introducing Claude 487.4Claude Opus 42025-05-22
Qwen3 Technical Report✓ Link86.70Qwen3-235B-A22B (Base)2025-05-14
Qwen3.5: Towards Native Multimodal Agents✓ Link86.7Qwen3.5-122B-A10B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link85.9Qwen3.5-27B2026-02-16
Introducing Claude 485.4Claude Sonnet 42025-05-22
Qwen3.5: Towards Native Multimodal Agents✓ Link85.2Qwen3.5-35B-A3B2026-02-16
On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability✓ Link84.86Qwen3.8-Flash-Next-Base2026-08-31
Qwen3 Technical Report✓ Link84.3Qwen3-235B-A22B (Thinking)2025-05-14
Gemma 4 Technical Report✓ Link83.4Gemma 4 12B Unified2026-07-02
Claude 3.7 Sonnet and Claude Code83.2Claude 3.7 Sonnet2025-02-24
DiffusionGemma Technical Report✓ Link81.5DiffusionGemma 26B A4B2026-07-31
gpt-oss-120b & gpt-oss-20b Model Card81.3gpt-oss-120b2025-08-08
Qwen3.5: Towards Native Multimodal Agents✓ Link81.2Qwen3.5-9B2026-02-16
Qwen3 Technical Report✓ Link79.8Qwen3-235B-A22B (Non-thinking)2025-05-14
ERNIE 5.0 Technical Report78.94ERNIE 5.0-Base2026-02-04
ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools✓ Link56.6GLM-4-9B-Chat2024-06-18
LFM2 Technical Report✓ Link55.26LFM2-8B-A1B (0-shot)2025-11-28
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs✓ Link49.3Phi-4-Mini (5-shot)2025-02-24