OpenCodePapers

question-answering-on-humanity-s-last-exam-hle

Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Claude Fable 5 and Claude Mythos 5✓ Link59.0Claude Mythos 52026-06-09
Gemini 3.1 Pro: A smarter model for your most complex tasks45.0Gemini 3.1 Pro2026-02-19
Kimi K3: Open Frontier Intelligence✓ Link43.5Kimi K3 (max)2026-07-27
Introducing GPT-5.442.7GPT-5.4 Pro2026-03-05
Introducing GPT-5.541.4GPT-5.52026-04-23
A new era of intelligence with Gemini 341.0Gemini 3 Deep Think2025-11-18
GLM-5.2: Built for Long-Horizon Tasks✓ Link40.5GLM-5.22026-06-16
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link37.7DeepSeek-V4-Pro Max2026-04-26
Motif 3: Technical Report✓ Link37.0Motif 32026-08-10
Introducing GPT-5.236.6GPT-5.2 Pro2025-12-11
Introducing Beam: Reflection's 501B open-weight model36.2Beam2026-10-05
Qwen3.8-Flash-Next✓ Link35.9Qwen3.8-Flash-Next2026-08-24
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link34.8DeepSeek-V4-Flash Max2026-04-26
Kimi K2.6✓ Link34.7Kimi K2.62026-04-20
Ornith-1.5: From Self-Scaffolding to Self-Improvement33.4Ornith-1.5-35B-A3B2026-08-20
GLM-5.1: Towards Long-Horizon Tasks✓ Link31.0GLM-5.12026-04-03
Qwen3.8-27B✓ Link30.8Qwen3.8-27B2026-08-05
Efficient Agentic Reasoning Through Self-Regulated Simulative Planning✓ Link30.4SR 2 AM-v1.0-30B2026-05-21
Kimi K2.5: Visual Agentic Intelligence✓ Link30.1Kimi K2.52026-02-02
Hy3 preview✓ Link30.0Hy3 preview2026-04-23
Qwen3.5: Towards Native Multimodal Agents✓ Link28.7Qwen3.5-397B-A17B2026-02-16
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence✓ Link28.0MiniMax-M2.72026-05-26
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link27.9Step-3.5-Flash PaCoRe2026-02-11
Streaming Communication in Multi-Agent Reasoning✓ Link27.68STREAM-MA (Claude Opus 4.6, Graph)2026-06-03
Qwen3.5: Towards Native Multimodal Agents✓ Link25.3Qwen3.5-122B-A10B (w/ CoT)2026-02-16
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link24.8GLM-4.72025-08-08
Qwen3.5: Towards Native Multimodal Agents✓ Link24.3Qwen3.5-27B (w/ CoT)2026-02-16
Qwen3.6✓ Link24.0Qwen3.6-27B2026-04-21
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link23.1Step-3.5-Flash2026-02-11
Kwai Keye-VL-2.0 Technical Report✓ Link22.9Keye-VL-2.0-30B-A3B (w/ CoT)2026-06-09
Qwen3.5: Towards Native Multimodal Agents✓ Link22.4Qwen3.5-35B-A3B (w/ CoT)2026-02-16
Muse Glimmer 30B: An On-Device Agentic Model✓ Link22.0Muse Glimmer-30B (High Reasoning, text-only)2026-10-17
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities21.6Gemini 2.5 Pro2025-07-07
Kolibri: A Sovereign European Model on the Pareto Frontier✓ Link21.5Kolibri2026-10-03
Qwen3.6✓ Link21.4Qwen3.6-35B-A3B2026-04-21
Introducing OpenAI o3 and o4-mini✓ Link20.32OpenAI o32025-04-16
MiniMax-M2.5✓ Link19.4MiniMax-M2.52026-02-12
Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning✓ Link19.11Intern-S2-Mobius-35B2026-08-14
Introducing K2 Horizon: Frontier Performance, Radically Open✓ Link18.6K2-Horizon-7B2026-09-03
DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Use✓ Link17.8Dive-8B (RL)2026-03-10
Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Model✓ Link17.8Nanbeige4.2-3B (w/o search)2026-07-21
Deeper is Not Always Better: Mitigating the Alignment Tax via Confident Layer Decoding✓ Link16.8Confident Decoding (Qwen3.5-27B)2026-06-20
Scalable Visual Pretraining for Language Intelligence16.67Qwen3.5-35B-A3B + VP2026-07-10
INTELLECT-3: Technical Report✓ Link14.6INTELLECT-32025-12-18
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link14.4GLM-4.5 (355B)2025-08-08
Thomson: Continual Learning of Frontier Models for SovereignAI13.4Thomson-1.0-Small2026-08-24
NVIDIA Nemotron 3.5 Lightning✓ Link11.72NVIDIA Nemotron 3.5 Lightning 30B-A3B2026-08-11
Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling✓ Link11.1Falcon-H1R (7B)2026-01-05
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities11.0Gemini 2.5 Flash2025-07-07
DiffusionGemma Technical Report✓ Link11.0DiffusionGemma 26B A4B2026-07-31
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link10.6GLM-4.5-Air2025-08-08
Is Next-Chunk Reasoning RL Really Better than SFT? Revisiting Training Strategies under no-CoT Data9.24Mixed SFT + RLVR2026-08-24
CHIMERA: Compact Synthetic Data for Generalizable LLM Reasoning9.0Qwen3-4B-Thinking-2507 (4B) fine-tuned on Chimera (SFT+RL)2026-03-01
Gemma 4 Technical Report✓ Link8.7Gemma 4 26B-A4B2026-07-02
LFM2.5-24B-A2B: Built for Fast On-Device Agents7.40LFM2.5-24B-A2B2026-10-13
Gemma 4 Technical Report✓ Link5.2Gemma 4 12B Unified2026-07-02
Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients5.1ZPPO (Qwen3.5-2B)2026-06-16
Kimi K2: Open Agentic Intelligence✓ Link4.7Kimi K22025-07-28
Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models2.0MELT-1.6B2026-05-08