OpenCodePapers

long-context-understanding-on-longbench-v2

Natural Language UnderstandingLong-Context Understanding
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Introducing Beam: Reflection's 501B open-weight model65.5Beam2026-10-05
Hy3 preview✓ Link65.4Hy3 preview2026-04-23
Qwen3.5: Towards Native Multimodal Agents✓ Link63.2Qwen3.5-397B-A17B2026-02-16
Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning✓ Link61.9Nemotron 3 Ultra2026-06-03
Kimi K2.5: Visual Agentic Intelligence✓ Link61.0Kimi K2.52026-02-02
MAI-Thinking-1: Building a Hill-Climbing Machine61MAI-Thinking-12026-06-02
MiMo-V2-Flash Technical Report✓ Link60.6MiMo-V2-Flash (Thinking)2026-01-06
Qwen3.5: Towards Native Multimodal Agents✓ Link60.6Qwen3.5-27B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link60.2Qwen3.5-122B-A10B2026-02-16
Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent✓ Link60.2Agents-A12026-06-29
Qwen3.5-Omni Technical Report59.6Qwen3.5-Omni-Plus2026-04-21
Qwen3.5: Towards Native Multimodal Agents✓ Link59.0Qwen3.5-35B-A3B2026-02-16
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link57.5Step-3.5-Flash2026-02-11
MiniMax-01: Scaling Foundation Models with Lightning Attention✓ Link56.5MiniMax-Text-012025-01-14
Qwen3.5: Towards Native Multimodal Agents✓ Link55.2Qwen3.5-9B2026-02-16
Kimi K2: Open Agentic Intelligence✓ Link49.1Kimi K22025-07-28
DeepSeek-V3 Technical Report✓ Link48.7DeepSeek-V32024-12-27
Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale✓ Link48.31Ling-2.6-1T2026-06-13
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression✓ Link45.2DeepSeek-V4.1-Flash Base2026-09-17
MiniCPM5-2B✓ Link43.7MiniCPM5-2B2026-09-07
Hunyuan Dense V1✓ Link43Hunyuan-7B-Instruct2025-07-30
Introducing LFM-7B: Setting New Standards for Efficient Language Models36.1LFM-7B2025-01-20
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models✓ Link27.2Youtu-LLM (2B, base)2025-12-31