OpenCodePapers

instruction-following-on-ifeval

Natural Language UnderstandingInstruction Following
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeInst-level loose-accuracyInst-level strict-accuracyPrompt-level loose-accuracyPrompt-level strict-accuracyModelNameReleaseDate
Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models✓ Link90.486.785.680.2AutoIF (Llama3 70B)2024-06-19
Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models✓ Link8886.182.380.2AutoIF (Qwen2 72B)2024-06-19
Instruction-Following Evaluation for Large Language Models✓ Link85.3783.5779.376.89GPT-42023-11-14
Instruction-Following Evaluation for Large Language Models✓ Link59.1155.7646.9543.07PaLM 2 S2023-11-14
DeepSeek-V3 Technical Report✓ Link86.1DeepSeek-V32024-12-27
Nemotron-4 340B Technical Report✓ Link79.9Nemotron-4-340B-Instruct2024-06-17
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning✓ Link83.3DeepSeek-R12025-01-22
Qwen2 Technical Report✓ Link77.6Qwen2-72B-Instruct2024-07-15
Qwen2 Technical Report✓ Link59.9Qwen2-57B-A14B-Instruct2024-07-15
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models✓ Link81.2Youtu-LLM 2B2025-12-31
Kimi K2: Open Agentic Intelligence✓ Link89.8Kimi K22025-07-28
Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone✓ Link85.03Ternary Bonsai 27B2026-07-14
NGM: A Plug-and-Play Training-Free Memory Module for LLMs✓ Link83.92Qwen3-14B + NGM2026-05-16
SmolLM - blazingly fast and remarkably powerful✓ Link18.48SmolLM 1.7B Instruct2024-07-16
J-Zero: Unified Challenger--Solver--Judge Co-Evolution from Zero Data✓ Link50.65J-Zero-4B2026-08-27
Knowing When Not to Reuse: Conditional Experience Transfer in Autonomous LLM Post-Training76.7Qwen3-4B + BCIT (prompt-level IFEval)2026-08-27
OmniEdu: Open Foundation Models for Learning and Teaching✓ Link82.07OmniEdu-27B2026-09-19
Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation✓ Link84.5DN-MOPD-9B2026-09-28
Rufus-Air: An Open LLM Post-Training Recipe95.4Rufus-Air2026-09-24
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model✓ Link63.8DeepSeek-V2 Chat (RL) (0-shot)2024-05-07
DeepSeek LLM: Scaling Open-Source Language Models with Longtermism✓ Link59.1DeepSeek LLM 67B Chat2024-01-05
2 OLMo 2 Furious✓ Link72.3OLMo 2 7B Instruct2024-12-31
2 OLMo 2 Furious✓ Link82.6OLMo 2 13B Instruct2024-12-31
2 OLMo 2 Furious✓ Link85.6OLMo 2 32B Instruct2024-12-31
OLMoE: Open Mixture-of-Experts Language Models✓ Link48.1OLMoE-1B-7B-Instruct2024-09-03
Jais 2: A Family of Arabic-Centric Open Large Language Models78.93Jais-2-70B2025-12-09
CoRT: Counterfactual Replay for Token-Level Rubric-Guided Policy Optimization93.48Qwen3-14B + CoRT (AON)2026-07-28
Carbon-X: When Natural Language Meets DNA✓ Link79.3Carbon-X2026-10-22