OpenCodePapers

instruction-following-on-multichallenge

Natural Language UnderstandingInstruction Following
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs✓ Link69.78Ling-3.1-flash2025-03-07
Qwen3.5: Towards Native Multimodal Agents✓ Link67.6Qwen3.5-397B-A17B2026-02-16
Rufus-Air: An Open LLM Post-Training Recipe65.8Rufus-Air2026-09-24
Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning✓ Link63.8Nemotron 3 Ultra2026-06-03
Qwen3.5: Towards Native Multimodal Agents✓ Link61.5Qwen3.5-122B-A10B2026-02-16
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link60.8Step-3.5-Flash PaCoRe2026-02-11
Qwen3.5: Towards Native Multimodal Agents✓ Link60.8Qwen3.5-27B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link60.0Qwen3.5-35B-A3B2026-02-16
Introducing OpenAI o3 and o4-mini✓ Link56.51OpenAI o32025-04-16
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link55.7Step-3.5-Flash2026-02-11
Qwen3.5: Towards Native Multimodal Agents✓ Link54.5Qwen3.5-9B2026-02-16
Kimi K2: Open Agentic Intelligence✓ Link54.1Kimi K22025-07-28
MAI-Thinking-1: Building a Hill-Climbing Machine53MAI-Thinking-12026-06-02
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link52.8GLM-4.5 (355B)2025-08-08
Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Acts✓ Link52.21Nanbeige4.1-3B2026-02-13
PaCoRe: Learning to Scale Test-Time Compute with Parallel Coordinated Reasoning✓ Link48.0PaCoRe-8B (high)2026-01-09
Introducing OpenAI o144.93OpenAI o12024-09-12
Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models✓ Link41.2Nanbeige4-3B-Thinking-25112025-12-06
From Production Traffic to Post-Training: Building a Self-Hosted LLM That Covers the Corporate Request Mix37.4T-pro-2.1 public2026-09-01
LSRIF: Logic-Structured Reinforcement Learning for Instruction Following32.3Qwen3-8B (LsrIF)2026-01-10
MiniCPM5-1B✓ Link19.48MiniCPM5-1B (Thinking)2026-05-25