OpenCodePapers

instruction-following-on-ifbench

Natural Language UnderstandingInstruction Following
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Mach-Mind-4-Flash Technical Report82.82Mach-Mind-4-Flash2026-07-10
Inkling-Small✓ Link82.2Inkling-Small2026-07-27
Sage-A1.5: From Long-Horizon Execution to Scientific Exploration with Capability Composition✓ Link81.6Sage-A1.52026-10-20
Qwen3.8-Flash-Next✓ Link81.3Qwen3.8-Flash-Next2026-08-24
Group Entropy-Controlled Policy Optimization80.7GEPO (Qwen3.5-9B)2026-07-18
Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent✓ Link80.6Agents-A12026-06-29
SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture✓ Link79.79SenseNova-U1-A3B-MoT2026-05-12
Introducing Beam: Reflection's 501B open-weight model79.7Beam2026-10-05
Qwen3.8-27B✓ Link79.5Qwen3.8-27B2026-08-05
Closing the Loop: Practical Training Recipes for Looped Language Models79.0Dory1.0-4B2026-09-30
Motif 3: Technical Report✓ Link78.2Motif 32026-08-10
MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training77.89Qwen3-30B-A3B + MOPD2026-06-29
Unified Audio Intelligence Without Regressing on Text Intelligence77.8Audex 30B-A3B2026-07-06
Muse Glimmer 30B: An On-Device Agentic Model✓ Link77.0Muse Glimmer-30B (High Reasoning)2026-10-17
Rufus-Air: An Open LLM Post-Training Recipe76.9Rufus-Air2026-09-24
Qwen3.5: Towards Native Multimodal Agents✓ Link76.5Qwen3.5-27B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link76.5Qwen3.5-397B-A17B2026-02-16
Qwen3.5: Towards Native Multimodal Agents✓ Link76.1Qwen3.5-122B-A10B2026-02-16
AgentGrad: Intervention-guided Prompt Optimization for Multi Agent Systems76.08AgentGrad (GPT-5-mini)2026-09-08
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence✓ Link76.0MiniMax-M2.72026-05-26
LFM2.5-24B-A2B: Built for Fast On-Device Agents74.69LFM2.5-24B-A2B2026-10-13
VibeThinker-3B: Exploring the Frontier of Verifiable Reasoning in Small Language Models✓ Link74.5VibeThinker-3B2026-06-15
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence✓ Link74.2Nemotron 3 Nano Omni2026-04-27
RUBRIC-ARROW: Alternating Pointwise Rubric Reward Modeling for LLM Post-training in Non-verifiable Domains✓ Link73.2RUBRIC-ARROW-voting@52026-05-27
NVIDIA Nemotron 3: Efficient and Open Intelligence✓ Link72.56Nemotron 3 Super2025-12-24
One Model to Loop Them All: Elastic Latent Recurrence for Language Models71.8Koi-4B2026-10-08
Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning✓ Link71.5NVIDIA-Nemotron-3-Nano-30B-A3B-BF162025-12-23
Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale71.2Intern-S1-Pro2026-03-26
Qwen3.5: Towards Native Multimodal Agents✓ Link70.2Qwen3.5-35B-A3B2026-02-16
Vela: User Behavior as Supervision Sparks LLM Intelligence✓ Link69.2Vela-35B-A3B (extra data)2026-10-10
MAI-Thinking-1: Building a Hill-Climbing Machine69MAI-Thinking-12026-06-02
SenseNova-U1.5: Towards Native Unified Visual Intelligence✓ Link69.0SenseNova-U1.5-8B-MoT2026-09-10
Olmo 3✓ Link68.1Olmo 3.1 Think 32B2025-12-15
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link67.4Step-3.5-Flash2026-02-11
K-EXAONE Technical Report✓ Link67.3K-EXAONE (236B, reasoning)2026-01-05
KAT-Coder-V2 Technical Report67.0KAT-Coder-V22026-03-29
NeoHorse-1: Towards Recursive Self-Improvement via Agentic Post-Training with Routing Harness✓ Link66.33NeoHorse-1-9B2026-09-08
Data Science and Technology Towards AGI Part I: Tiered Data Management✓ Link66.3MiniCPM5-2B2026-02-09
Qwen3.5: Towards Native Multimodal Agents✓ Link64.5Qwen3.5-9B2026-02-16
EXAONE 4.5 Technical Report✓ Link62.6EXAONE 4.5 (Reasoning)2026-04-09
LFM2.5-2.6B: Deploy Agents Everywhere✓ Link59.17LFM2.5-2.6B2026-08-04
Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone✓ Link58.50Ternary Bonsai 27B2026-07-14
Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale✓ Link57.62Ling-2.6-1T2026-06-13
Ling and Ring 2.6 Technical Report: Efficient and Instant Agentic Intelligence at Trillion-Parameter Scale✓ Link57.40Ling-2.6-flash2026-06-13
Ling-2.6-1T: A Trillion-Parameter Comprehensive Flagship Model for Complex Tasks57.00Ling-2.6-1T2026-04-29
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link56.8Step-3.5-Flash PaCoRe2026-02-11
LFM2.5-8B-A1B: an Even Better on-Device Mixture-of-Experts✓ Link56.47LFM2.5-8B-A1B2026-05-28
Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Model✓ Link54.6Nanbeige4.2-3B2026-07-21
Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling✓ Link53.4Falcon-H1R (7B)2026-01-05
Qwen3.5-Omni Technical Report52.6Qwen3.5-Omni-Plus2026-04-21
Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation51.72TGOPD (4B multi-domain GRPO-fallback)2026-09-02
RubricHub: A Comprehensive and Highly Discriminative Rubric Dataset via Automated Coarse-to-Fine Generation✓ Link51.4Qwen3-14B (RuFT→RuRL)2026-01-13
Shepherd: A Runtime Substrate Empowering Meta-Agents with a Formalized Execution Trace51.3CRO2026-05-11
HY-MT1.5 Technical Report✓ Link50.67Hy-MT2-30B-A3B2025-12-30
ROSS: Relearning from Self-Generated Rollouts through Selective Supervision47.76ROSS (Qwen3.6-35B-A3B)2026-09-28
Introducing LFM2.5: The Next Generation of On-Device AI47.33LFM2.5-1.2B-Instruct2026-01-05
Post-Trained MoE Can Skip Half Experts via Self-Distillation✓ Link47.3ZEDA (GLM-4.7-Flash)2026-05-18
MiniCPM5-1B✓ Link46.67MiniCPM5-1B (Thinking)2026-05-25
LFM2.5-1.2B-Thinking: On-Device Reasoning Under 1GB44.85LFM2.5-1.2B-Thinking2026-01-20
HarnessRL: Co-Evolving Policies with a Just-in-Time Training Harness for Open-Ended RL✓ Link43.6HarnessRL (Qwen3.5-9B)2026-10-19
Trust Region On-Policy Distillation42.18TrOPD (Qwen3-SFT-1.7B)2026-05-31
CoRT: Counterfactual Replay for Token-Level Rubric-Guided Policy Optimization41.09CoRT (Qwen3-14B)2026-07-28
LFM2.5-350M: No Size Left Behind40.69LFM2.5-350M2026-03-31
Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation✓ Link38.7DN-MOPD-9B2026-09-28
LFM2.5-230M: Built to Run Anywhere38.40LFM2.5-230M2026-06-25
Bootstrapping Exploration with Group-Level Natural Language Feedback in Reinforcement Learning✓ Link38.33GOLF (Qwen-3-8B)2026-03-04
p1: Better Prompt Optimization with Fewer Prompts37.41p1 p1 (Qwen3-4B-Instruct-2507)2026-04-09
Cosmos 3: Omnimodal World Models for Physical AI✓ Link37.0Cosmos3-Super2026-06-01
ACLArena: Agent Continue Learning in Multi-stage Post-training✓ Link29.1MLE (ACLArena) (extra data)2026-09-21
MOPD-Router: Rethinking Teacher Routing in Multi-Teacher On-Policy Distillation✓ Link28.91MOPD-Router (ExpertAlign, Qwen3-4B-Non-Thinking student, domain-labeled)2026-09-25
Enhancing Rubric-based RL via Self-Distillation28.3CriPO-RS (Qwen3-4B)2026-07-21
Weak-to-Strong On-Policy Distillation✓ Link27.0W2S-OPD (pre-/post-RL contrast)2026-07-28
LFM2 Technical Report✓ Link25.85LFM2-8B-A1B2025-11-28
Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation✓ Link24.67Open-MOPD (SmolLM3-3B)2026-08-19
MobileMoE: Scaling On-Device Mixture of Experts20.1MobileMoE-L (922M)2026-05-26
ARC: Fair Relative Advantage Comparison in Open-Ended Real-World Interaction17.35DAPO + ARC (Qwen3-8B)2026-08-13