OpenCodePapers

mathematical-reasoning-on-aime-2025

Mathematical Reasoning
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Introducing GPT-5.2100.0GPT-5.22025-12-11
Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification100.0K2-Horizon-7B + Magenta2026-09-10
Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation98.6Nemotron-Cascade-2-30B-A3B2026-03-19
Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexity98.3Seed2.0 Pro2026-06-30
SimpleOPD: Simple Tokenizer-Agnostic On-Policy Distillation for Long-Context Reasoning✓ Link97.5Intern-S2-DS-OPD2026-08-14
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters✓ Link97.3Step-3.5-Flash2026-02-11
Nemotron-Math: Efficient Long-Context Distillation of Mathematical Reasoning from Multi-Mode Supervision✓ Link97.29Qwen3-30B-A3B (fine-tuned on Nemotron-Math AoPS+StackExchange-Math subset, high reasoning, Python TIR)2025-12-17
MAI-Thinking-1: Building a Hill-Climbing Machine97.0MAI-Thinking-12026-06-02
Kolibri: A Sovereign European Model on the Pareto Frontier✓ Link96.9Kolibri2026-10-03
Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling✓ Link96.7Falcon-H1R (7B) with DeepConf@5122026-01-05
Long-horizon Reasoning Agent for Olympiad-Level Mathematical Problem Solving96.6Intern-S1-MO2025-12-11
Kimi K2.5: Visual Agentic Intelligence✓ Link96.1Kimi K2.52026-02-02
DeepSeek-V3.2 Technical Report✓ Link96.0DeepSeek-V3.2-Speciale2025-12-02
Streaming Communication in Multi-Agent Reasoning✓ Link95.83STREAM-MA (Claude Opus 4.6, Graph)2026-06-03
Introducing Gemini 3 Flash95.2Google Gemini 3 Flash (Thinking)2025-12-17
A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM✓ Link95.0A*-Thought-V2 (Qwen3.6-27B, tau=60)2026-09-07
Introducing GPT-594.6GPT-52025-08-07
Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling✓ Link94.6SU-012026-05-13
MiMo-V2-Flash Technical Report✓ Link94.1MiMo-V2-Flash (Thinking)2026-01-06
MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training94.1MiMo-V2-Flash + MOPD2026-06-29
Learning More by Training Less: Uncertainty-Guided Progressive Contraction for Efficient Reasoning Post-Training✓ Link93.3Qwen3.5-9B (rho=30%)2026-10-09
ReTerm: Recovery Training for Self-Improving Terminal Agents✓ Link93.3ReTerm-9B2026-10-13
Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale93.1Intern-S1-Pro2026-03-26
EXAONE 4.5 Technical Report✓ Link92.9EXAONE 4.5 (Reasoning)2026-04-09
K-EXAONE Technical Report✓ Link92.8K-EXAONE (236B, reasoning)2026-01-05
Introducing OpenAI o3 and o4-mini✓ Link92.7OpenAI o4-mini2025-04-16
IndexCache: Accelerating Sparse Attention via Cross-Layer Index Reuse✓ Link92.6DSA (30B) + IndexCache (1/4, searched pattern)2026-03-12
Mach-Mind-4-Flash Technical Report92.08Mach-Mind-4-Flash2026-07-10
Group Entropy-Controlled Policy Optimization91.4GEPO (Qwen3.5-9B)2026-07-18
Unified Audio Intelligence Without Regressing on Text Intelligence91.2Audex 30B-A3B2026-07-06
Efficient Agentic Reasoning Through Self-Regulated Simulative Planning✓ Link91.1SR 2 AM-v1.0-30B2026-05-21
Ring-Zero: Scaling Zero RL to a Trillion Parameters for Emergent Reasoning91.0Ring-2.5-1T-Zero (High)2026-07-14
Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone✓ Link90.84Ternary Bonsai 27B2026-07-14
Unlocking Lossless Speedups in LLMs via Discrete Diffusion✓ Link90.7Uno (K2-Horizon-7B-Uno)2026-09-03
Scalable Visual Pretraining for Language Intelligence90.21Qwen3.5-35B-A3B + VP2026-07-10
Limite 1B - Violetto: Technical Report✓ Link90.21Limite 1B - Violetto2026-10-06
PRISM: Pushing the Frontier of Deep Think via Process Reward Model-Guided Inference✓ Link90.0PRISM (gpt-oss-20b; PRM-score Vote)2026-03-03
ACC: Compiling Agent Trajectories for Long-Context Training90.0Qwen3-30B-A3B-Thinking + ACC2026-05-21
Thought-Level Beam Search for Reasoning✓ Link90.0Gambit (Qwen3-4B-Thinking-2507)2026-08-11
Qwen3-VL Technical Report✓ Link89.7Qwen3-VL-235B-A22B-Thinking2025-11-26
Granite 4.2 LLMs: How They're Built✓ Link89.17Granite-4.2-30B2026-08-25
Recursive Think-Answer Process for LLMs and VLMs88.7Qwen3-235B-A22B-R-TAP (MoE, 235B)2026-03-02
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities88.0Gemini 2.5 Pro2025-07-07
INTELLECT-3: Technical Report✓ Link88.0INTELLECT-32025-12-18
Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoning✓ Link86.7DASD-30B-A3B-Thinking-Preview (30B MoE)2026-01-14
Recursive Multi-Agent Systems✓ Link86.7RecursiveMAS2026-04-28
SkillOS: Learning Skill Curation for Self-Evolving Agents86.7SkillOS (Qwen3-8B curator) with Gemini-2.5-Pro executor2026-05-07
Kwai Keye-VL-2.0 Technical Report✓ Link86.7Keye-VL-2.0-30B-A3B2026-06-09
Data Science and Technology Towards AGI Part I: Tiered Data Management✓ Link86.5MiniCPM5-2B2026-02-09
QwenLong-L1.5: Post-Training Recipe for Long-Context Reasoning and Memory Management✓ Link86.46QwenLong-L1.5-30B-A3B2025-12-15
Is Next-Chunk Reasoning RL Really Better than SFT? Revisiting Training Strategies under no-CoT Data85.73Mixed SFT + RLVR2026-08-24
Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models✓ Link85.6Nanbeige4-3B-Thinking-25112025-12-06
EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes✓ Link85.3EXAONE 4.0 32B (Reasoning)2025-07-15
Solar Open Technical Report✓ Link84.3Solar Open (102B)2026-01-11
Loop the Loopies!83.75Loopie-20B-A2B (Thinking)2026-07-17
Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Models83.3Nemotron-Cascade (14B, Thinking)2025-12-15
PACT: From Credit Assignment to Critic Alignment✓ Link83.12PACT (Qwen3.5-4B)2026-09-22
Qwen3-Coder-Next Technical Report✓ Link83.07Qwen3-Coder-Next2026-02-28
Learning to Build the Environment: Self-Evolving Reasoning RL via Verifiable Environment Synthesis83.0EvoEnv (Qwen3-4B-Thinking-2507)2026-05-14
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence✓ Link82.1Nemotron 3 Nano Omni2026-04-27
Qwen3 Technical Report✓ Link81.5Qwen3-235B-A22B (Thinking)2025-05-14
CHIMERA: Compact Synthetic Data for Generalizable LLM Reasoning80.7Qwen3-4B-Thinking-2507 (4B) fine-tuned on Chimera (SFT+RL)2026-03-01
Safin-1: Safety from Within through Memory-Native State Evolution✓ Link80.1Safin-1-35B-A3B-SFT2026-08-31
Introspective Diffusion Language Models✓ Link80.0I-DLM (32B)2026-04-13
Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models✓ Link80.0Qwen3-30B-A3B-Thinking with PUMA2026-05-17
JudgeRLVR: Judge First, Generate Second for Efficient Reasoning79.7Mixed Strategy (Qwen3-30B-A3B)2026-01-13
Figure It Out: Improving the Frontier of Reasoning with Active Visual Thinking✓ Link79.32FigR2025-12-30
Introducing OpenAI o179.2OpenAI o12024-09-12
OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization✓ Link78.89OSCAR (GLM-4.7, 358B)2026-05-18
Reasoning over mathematical objects: on-policy reward modeling and test time aggregation78.12Principia-4B2026-03-19
Olmo 3✓ Link78.1Olmo 3.1 Think 32B2025-12-15
Claude Opus 4.178.0Claude Opus 4.12025-08-05
Heterogeneous Agent Collaborative Reinforcement Learning75.7Qwen3-4B-Instruct (HACPO)2026-03-03
Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information✓ Link75.6Qwen3-30B-A3B + AntiSD2026-05-12
Hunyuan Dense V1✓ Link75.3Hunyuan-7B-Instruct2025-07-30
Reasoning Cache: Continual Improvement Over Long Horizons via Short-Horizon RL✓ Link74.9RCT-4B + RC2026-02-03
Lightning Weave: Improving the Accuracy-Efficiency Frontier of Reasoning Models through Capability Composition74.6Lightning Weave (Qwen3.5-4B)2026-09-13
Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation74.22TGOPD (35B multi-domain mask-only)2026-09-02
TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning74.2TERMINATOR (Qwen3-14B)2026-03-13
D^3-MOPD: Adaptive Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation74.1D3-MOPD Qwen3.6-35B-A3B (benchmark-best checkpoint)2026-08-25
Qwen3-Omni Technical Report✓ Link74.0Qwen3-Omni-Flash-Thinking2025-09-22
Chain of Mindset: Reasoning with Adaptive Cognitive Modes✓ Link73.33Chain of Mindset (CoM) (Qwen3-VL-32B-Instruct)2026-02-10
ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search✓ Link73.33ZGCM-12026-09-11
Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation72.78N-OPSD (Qwen3-8B)2026-09-30
Overcoming Scaling Limits in On-Policy Self-Distillation for LLM Reasoning72.22OASIS (Qwen3-8B) (extra data)2026-09-29
DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning✓ Link72.2DoubtLess (Qwen3-32B steered by Qwen3-0.6B)2026-10-13
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities72.0Gemini 2.5 Flash2025-07-07
TriPlay-RL: Tri-Role Self-Play Reinforcement Learning for LLM Safety Alignment71.56M Blue (14B)2026-01-26
TTPO: Test-Time Policy Optimization✓ Link71.4Qwen3-8B + TTPO2026-08-27
On-Policy Self-Distillation without Any Supervision✓ Link71.39u-OPSD Qwen3-8B (thinking)2026-08-09
SCALE: Selective Resource Allocation for Overcoming Performance Bottlenecks in Mathematical Test-time Scaling✓ Link71.25Qwen3-32B (SCALE)2025-11-29
Where the Model Changes Its Mind: Hindsight-Divergence Localization for Efficient Reinforcement Learning with Verifiable Rewards70.56HDL (Qwen3-8B)2026-09-29
CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning✓ Link70.42CopT (Qwen3-8B)2026-05-19
Distilling Long-CoT Reasoning through Collaborative Step-wise Multi-Teacher Decoding✓ Link70.2R1-Qwen (32B) with CoRD (heterogeneous teachers)2026-05-04
How to Fine-Tune a Reasoning Model? A Teacher-Student Cooperation Framework to Synthesize Student-Consistent SFT Data✓ Link70.1TESSY2026-03-23
ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning✓ Link69.7ThoughtFold (Qwen3-14B)2026-06-02
SPADE: Self-Play in Adaptive Synthetic Executable Environments✓ Link68.8SPADE (Games, Qwen3-8B)2026-08-19
Rubric-based On-policy Distillation✓ Link68.75ROPD (Qwen3-4B)2026-05-08
Not All Tokens Deserve Equal Credit: Counterfactual Sensitivity Credit Reallocation for Long-CoT Reasoning68.3CSCR (Qwen3-4B)2026-07-30
DataChef: Cooking Up Optimal Data Recipes for LLM Adaptation via Reinforcement Learning✓ Link66.7DataChef-32B2026-02-11
OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification65.63OmniOPD (Qwen3-4B student, Claude-4.5-haiku teacher)2026-05-31
iGRPO: Self-Feedback-Driven LLM Reasoning65.57OpenMath-Nemotron-14B + iGRPO2026-02-09
Surprising Success, Repeated Failure: Entropy-Guided Credit Assignment for Exploration in LLM Reasoning✓ Link65.3Olmo-3-7B-Think-DPO + EAPO2026-09-27
KnowRL: Boosting LLM Reasoning via Reinforcement Learning with Minimal-Sufficient Knowledge Guidance✓ Link65.21KnowRL-Nemotron-1.5B (CSS)2026-04-14
SePO: Self-Evolving Prompt Agent for System Prompt Optimization64.22SePO-Generalist2026-06-03
Efficient Reasoning with Balanced Thinking✓ Link63.3ReBalance (QwQ-32B)2026-03-12
Scaling Embeddings Outperforms Scaling Experts in Language Models63.23LongCat-Flash-Lite (68.5B)2026-01-29
JustRL: Scaling a 1.5B LLM with a Simple RL Recipe✓ Link62.92JustRL-Nemotron 1.5B2025-12-18
On-Policy Self-Distillation for Reasoning Compression✓ Link61.7Qwen3-14B (OPSDC)2026-03-05
Calibrating Teacher--Student Discrepancy for On-Policy Distillation61.3Cal-OPD (Qwen3-30B-A3B-Thinking-2507 -> Qwen3-4B)2026-09-18
LongCat-Flash Technical Report✓ Link61.25LongCat-Flash2025-09-01
Weak-to-Strong On-Policy Distillation✓ Link61.0W2S-OPD (multi-teacher contrast)2026-07-28
Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation✓ Link60.52Waypoint-OPD (Qwen3-14B)2026-10-15
ThreadWeaver: Adaptive Threading for Efficient Parallel Reasoning in Language Models✓ Link60.5ThreadWeaver (Qwen3-8B)2025-11-24
LLaDA2.0: Scaling Up Diffusion Language Models to 100B✓ Link60.0LLaDA2.0-flash2025-12-10
Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision✓ Link60.0SD-Zero (Qwen3-4B-Instruct)2026-04-13
Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment✓ Link59.2Qwen-3-14B (fine-tuned with Rank-Surprisal Ratio selection)2026-01-20
Lightning OPD: Efficient Post-Training for Large Reasoning Models with Offline On-Policy Distillation✓ Link59.2Qwen3-8B-Base (Lightning OPD)2026-04-14
ExpRL: Exploratory RL for LLM Mid-Training✓ Link59.07ExpRL-Outcome (Ours)2026-06-15
SFT Conflicts, RL Coexists: A Theoretical and Empirical Analysis of Multi-Task Learning for LLMs✓ Link59.0Adapted Parallel-RL (DeepSeek-R1-Distill-Qwen-7B)2026-08-06
Can We Trust the Teacher? Decoupled Credit Direction-Magnitude for Self-Distillation57.5DCSD (Qwen3-4B)2026-09-28
Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation57.4Road MOPD (Qwen3-4B)2026-10-09
Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling57.1RL-guided (Qwen3-4B-Instruct-Thinking)2026-06-02
Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation✓ Link56.04Qwen3-8B + OPRD2026-09-08
Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation✓ Link55.83FiRe-OPD2026-06-01
Rethinking Sample Polarity in Reinforcement Learning with Verifiable Rewards54.1A3PO (Deepseek-R1-Distill-Qwen-7B)2025-12-25
Efficient Reasoning on the Edge54.0Qwen2.5-7B-Instruct (OT3, dense)2026-03-17
SAF-OPD: Stable Advantage Fusion for On-Policy Distillation53.96SAF (Qwen3-4B)2026-07-31
Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning✓ Link53.8NPR (Qwen3-4B)2025-12-08
MOPD-Router: Rethinking Teacher Routing in Multi-Teacher On-Policy Distillation✓ Link53.75MOPD-Router (ExpertAlign, Qwen3-4B-Non-Thinking student, domain-labeled)2026-09-25
Influence-Directed Distillation: Solving the Diversity Bottleneck in Sampled-Token On-Policy Distillation53.3Qwen3-4B-Non-Thinking + IDA-OPD2026-08-30
The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation✓ Link52.92RIDE (Qwen3-4B -> Just-Qwen3-4B)2026-09-29
Self-Hinting Language Models Enhance Reinforcement Learning✓ Link52.1SAGE (Qwen3-4B-Instruct)2026-02-03
LFM2.5-2.6B: Deploy Agents Everywhere✓ Link51.87LFM2.5-2.6B2026-08-04
In-Context Reinforcement Learning for Tool Use in Large Language Models✓ Link51.7Qwen3-8B (ICRL)2026-03-09
TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs✓ Link51.6TGRL (Qwen3-32B) (extra data)2026-09-27
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding50.0Nemotron-Labs-Diffusion-14B (Diff.)2026-07-07
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models✓ Link49.8Youtu-LLM 2B2025-12-31
LSRIF: Logic-Structured Reinforcement Learning for Instruction Following49.6Distill-Qwen-14B (LsrIF)2026-01-10
Co-Evolving Policy Distillation49.58CoPD2026-04-29
Kimi K2: Open Agentic Intelligence✓ Link49.5Kimi K22025-07-28
Entropy Ratio Clipping as a Soft Global Constraint for Stable Reinforcement Learning48.4ERC-DAPO (DeepSeek-R1-Distill-Qwen-7B)2025-12-05
ARISE: Agent Reasoning with Intrinsic Skill Evolution in Hierarchical Reinforcement Learning✓ Link48.3ARISE + GRPO (Qwen3-4B-Instruct-2507)2026-03-17
RISE: Recursive Improvement via Self-Extrapolating Policy Distillation47.9RISE (logit,Qwen3-8B,beta0=1.5)2026-09-04
Learning from Your Own Mistakes: Constructing Learnable Micro-Reflective Trajectories for Self-Distillation46.88Cold-start + TAPO (Qwen3-8B-Instruct)2026-06-17
CoTranslator: Reverse to Forward Chain-of-Thought Translator for Reasoning Distillation45.36CoTranslator (Qwen3-4B-Thinking-2507)2026-10-14
TEMPO: Scaling Test-time Training for Large Reasoning Models✓ Link44.6Qwen3-14B-Base (TEMPO)2026-04-21
Trust Region On-Policy Distillation44.06TrOPD (Qwen3-SFT-1.7B)2026-05-31
Weak-to-Strong Generalization via Direct On-Policy Distillation✓ Link44.0R1-Distill-7B (Direct-OPD)2026-07-06
Hybrid Reasoning Agents✓ Link43.3HybridAgent (14B)2026-10-13
Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models43.2DS-R1-Distill-Qwen-7B + OPD Dynamic Sampling2026-08-17
LFM2.5-8B-A1B: an Even Better on-Device Mixture-of-Experts✓ Link42.53LFM2.5-8B-A1B2026-05-28
From P(y|x) to P(y): Investigating Reinforcement Learning in Pre-train Space✓ Link42.19DSRL (Qwen3-8B)2026-04-15
Bootstrapping Exploration with Group-Level Natural Language Feedback in Reinforcement Learning✓ Link41.65GOLF (Qwen-3-8B)2026-03-04
STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability✓ Link41.5STARE-O1 (DeepSeek-R1-Distill-Qwen-1.5B)2026-06-17
MHPO: Modulated Hazard-aware Policy Optimization for Stable Reinforcement Learning41.4MHPO (Qwen3-4B-Base)2026-03-14
ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning✓ Link41.1ResRL (Qwen3-8B)2026-05-01
MiniCPM5-1B✓ Link40.42MiniCPM5-1B (Thinking)2026-05-25
TREK: Distill to Explore, Reinforce to Refine40.3Qwen3-8B + TREK (DeepSeek-V4 proposals)2026-07-06
Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning40.0Atlas (RL) (pool extension)2026-01-07
Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?✓ Link40.0DeepSeek-R1-Distill-Qwen-7B (SFT on D_ug)2026-03-25
GlimpRouter: Efficient Collaborative Inference by Glimpsing One Token of Thoughts✓ Link39.17GlimpRouter (Qwen3-4B SLM + DeepSeek-R1-Distill-Qwen-32B LLM)2026-01-08
IIB-LPO: Latent Policy Optimization via Iterative Information Bottleneck38.3I2B-LPO (Qwen3-14B)2026-01-09
DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards✓ Link37.92DelTA (Qwen3-14B-Base)2026-05-20
Recovering Reliable Supervision via Critique-Guided On-Policy Distillation✓ Link37.81CriticOPD (Olmo-3-7B-Instruct-SFT)2026-10-14
On the Step Length Confounding in LLM Reasoning Data Selection✓ Link37.5Qwen3-8B-Base (Aslec-casl)2026-04-08
Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations37.5Qwen3-1.7B (OPD+Clip)2026-07-15
Approximation of Log-Partition Function in Policy Mirror Descent Induces Implicit Regularization for LLM Post-Training✓ Link37.19PMD-mean (Qwen3-30B-A3B-Base, τ=0.1)2026-02-05
Selection Is Not Learning: Choosing Model Futures37.15EvoHeir (Gemma-4-E4B-it)2026-10-15
SmolLM3: smol, multilingual, long-context reasoner✓ Link36.7SmolLM3 3B (Extended Thinking)2025-07-08
LFM-1B-Math: Can Small Models Be Concise Reasoners?36.25LFM-1.3B-Distill (32K output budget)2025-06-24
Understanding On-Policy Distillation: A Mechanistic Interpretability Perspective via Sparse Crosscoders✓ Link36.0OPD student (JustRL)2026-09-28
Prefix Sliding for efficient test-time scaling✓ Link35.8Qwen3-1.7B (Prefix Sliding)2026-08-26
PACED: Distillation at the Frontier of Student Competence35.6Paced Forward KL (Qwen3-8B)2026-03-11
ERNIE 4.5 Technical Report✓ Link35.1ERNIE-4.5-300B-A47B2025-06-30
Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability35.1Strict top-16 (Qwen3-235B-A22B-Instruct-2507 -> Granite-4.1-8B)2026-10-06
LEAD: Length-Efficient Adaptive and Dynamic Reasoning for Large Language Models✓ Link35.0LEAD (DeepSeek-R1-Distill-Qwen-7B)2026-05-10
Introducing Claude 433.9Claude Opus 42025-05-22
Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe✓ Link33.8R1-Distill-1.5B + Top-16 OPD2026-04-14
MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning33.33MetaAgent-X RL (Qwen3 8B)2026-05-14
Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models33.3MELT-1.6B2026-05-08
Introducing Claude 433.1Claude Sonnet 42025-05-22
Composing What Each Teacher Learned: Multi-Teacher On-Policy Distillation through Teacher-Relative Shifts32.92Δ-MOPD (1.5B student, Avg@16)2026-10-07
TriAttention: Efficient Long Reasoning with Trigonometric KV Compression✓ Link32.9TriAttention (Qwen3-8B)2026-04-06
LFM2.5-1.2B-Thinking: On-Device Reasoning Under 1GB31.73LFM2.5-1.2B-Thinking2026-01-20
Graph-Based Chain-of-Thought Pruning for Reducing Redundant Reflections in Reasoning LLMs31.67DeepSeek-R1-Distill-Qwen-7B (Graph-based CoT Pruning)2026-04-07
On the Off-Policy Teacher in On-Policy Distillation31.2SCOUT2026-09-29
Group Adaptive Clipping Policy Optimization✓ Link30.8DeepSeek-R1-Distill-Qwen-1.5B + GAPO2026-08-31
APPO: Agentic Procedural Policy Optimization✓ Link30.0APPO (Qwen2.5-7B-Instruct)2026-06-10
When Reasoning Meets Its Laws✓ Link29.2DeepSeek-R1-8B (SFT-Compo)2025-12-19
On-policy Distillation with Verifiable Reward✓ Link28.1OPDVR (Qwen3-4B)2026-08-25
PRISM: Demystifying Retention and Interaction in Mid-Training27.96Granite-3.3 (8B) PRISM2026-03-17
Towards Full Pipeline FP8 Reinforcement Learning for LLMs27.1Qwen3-8B-Base + Calibrated Clipping (Blockwise FP8)2026-09-19
Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients26.7ZPPO (Qwen3.5-2B)2026-06-16
Beyond Imitation: Filtering On-Policy Distillation by Reasoning Progress25.83R²-OPD (Qwen3-1.7B)2026-08-19
Branching On-Policy Distillation25.83BranchOPD (extra data)2026-10-09
ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning✓ Link25.2ReSPO (Qwen3-30B-A3B-Base, N=8)2026-09-28
DenoiseRL: Bootstrapping Reasoning Models to Recover from Noisy Prefixes✓ Link24.8DenoiseRL-DAPO (Qwen3-8B-Base)2026-05-27
Qwen3 Technical Report✓ Link24.7Qwen3-235B-A22B (Non-thinking)2025-05-14
Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO24.5DeepSeek-R1-Distill-Qwen-1.5B (GRPO to ES)2026-08-27
Arcee Trinity Large Technical Report✓ Link24.36Trinity Large Preview2026-02-19
Normalized Low-Rank Adaptation✓ Link23.5DS-R1-Distill-Qwen1.5B NoRA2026-08-31
Your Group-Relative Advantage Is Biased23.3DAPO+HA-DW (Qwen-3-8B-Base)2026-01-13
BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoning✓ Link23.3BeamPERL (best-performing checkpoint)2026-03-04
TIP: Token Importance in On-Policy Distillation✓ Link23.2TIP Soft-OR 20% (Qwen3-8B → Qwen3-4B)2026-04-15
Mitigating the Length-Scaling Tax with Online Distillation22.92LSD (SG-FKL)2026-09-30
DiRL: An Efficient Post-Training Framework for Diffusion Language Models✓ Link22.9DiRL-8B-Instruct2025-12-23
Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation✓ Link22.86Open-MOPD (SmolLM3-3B)2026-08-19
Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO✓ Link22.51.7B→8B S2L2026-06-02
WHALE: A Simple Recipe for Joint Harness-Weight Optimization✓ Link22.5Qwen3.5-2B + WHALE (E0.6,I6)2026-08-31
KV4-RL: Unlocking Faster Asynchronous Rollouts for RLVR with INT4 KV Cache Quantization22.1KV4-RL (Qwen3-8B-Base)2026-10-10
Learning to Solve Hard Problems in RL for LLMs by Never Giving Up22.0Qwen 3 4B + NGU (p=0.5)2026-09-11
The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents21.1Qwen2.5-3B with CAR (MSCR)2026-01-12
Can LLMs Learn to Reason Robustly under Noisy Supervision?✓ Link20.8Qwen3-4B-Base (with OLR)2026-04-05
Can LLMs Guide Their Own Exploration? Gradient-Guided Reinforcement Learning for LLM Reasoning20.1G2RL (Qwen3-4B-Base)2025-12-17
SPARK: Stepwise Process-Aware Rewards for Reference-Free Reinforcement Learning20.0PRM-CoT (Process-Aware) (Qwen2.5-Math-7B)2025-12-02
nabla-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space✓ Link20.0∇-Reasoner (Qwen-2.5-7B-Instruct)2026-03-05
Sparse but Critical: A Token-Level Analysis of Distributional Shifts in RLVR Fine-Tuning of LLMs20.0Qwen2.5-Math-7B with DAPO (High-KL boost)2026-03-23
Unlocking Token Rewards via Training-Free Reward Attribution20.0Qwen2.5-Math-7B + GRPO (P2T token reward) (extra data)2026-06-03
LLaDA MoE v2: Scaling Mixture-of-Experts Diffusion Language Models20.00LLaDA MoE v2 Instruct2026-08-04
Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge✓ Link19.7Multiplex Thinking (DeepSeek-R1-Distill-Qwen-7B)2026-01-13
Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation✓ Link19.4OPDLM-8B (think@eval)2026-06-04
SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation✓ Link17.92SPOT Qwen3-4B-Base2026-08-05
Think Anywhere in Code Generation✓ Link17.7Think-Anywhere2026-03-31
Adaptive Ability Decomposing for Unlocking Large Reasoning Model Effective Reinforcement Learning17.1A2D (Qwen2.5-7B-Instruct)2026-01-31
Low-rank Optimization Trajectories Modeling for LLM RLVR Acceleration✓ Link16.7Qwen2.5-14B-Instruct with NExt2026-04-13
Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance✓ Link16.67Falcon-H1-34B-Instruct2025-07-30
J-Zero: Unified Challenger--Solver--Judge Co-Evolution from Zero Data✓ Link15.94J-Zero-8B2026-08-27
Learning to Hint for Reinforcement Learning✓ Link15.3HiLL (Qwen2.5-7B-Instruct)2026-04-01
From Reasoning Chains to Verifiable Subproblems: Curriculum Reinforcement Learning Enables Credit Assignment for LLM Reasoning15.3SCRL (Qwen3-4B-Base)2026-05-21
Long Live The Balance: Information Bottleneck Driven Tree-based Policy Optimization✓ Link15.3IBTPO (Qwen3-8B-Base)2026-05-27
Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance✓ Link14.58FEST-GRPO2026-05-14
Dynamic Important Example Mining for Reinforcement Finetuning✓ Link14.2Qwen3-4B + DIEM2026-08-29
Introducing LFM2.5: The Next Generation of On-Device AI14.00LFM2.5-1.2B-Instruct2026-01-05
Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play✓ Link13.3Stratagem (Kuhn Poker)2026-04-20
Solving Physics Olympiad via Reinforcement Learning on Physics Simulators✓ Link12.5Qwen2.5-32B + RL (synthetic)2026-04-13
G-Zero: Self-Play for Open-Ended Generation from Zero Data✓ Link12.4Qwen3-8B-Base (G-Zero R2)2026-05-11
Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning11.7Qwen2.5-Math-7B + ACE-DAPO2026-02-24
Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR✓ Link10.9DATPO (Qwen3-4B-Base)2026-09-08
Enabling Token-wise Importance Sampling in Off-Policy RLVR with Proximal KL Regularization✓ Link10.63Proximal KL (Qwen3-4B-Base, off-policy, staleness 4, lr 5e-6)2026-10-13
Gains and Collapse in On-Policy Distillation:A Reinforcement Learning Perspective✓ Link10.04B → SFT (warmup)2026-10-02
The Molecular Structure of Thought: Mapping the Topology of Long Chain-of-Thought Reasoning8.33Llama-3.1-8B-Instruct + Mole-Syn-by-Qwen-32B2026-01-09
Locally Confident, Globally Stuck: The Quality-Exploration Dilemma in Diffusion Language Models7.4000WeDLM-8B (IMH)2026-04-01
Trust-Region Behavior Blending for On-Policy Distillation6.9Trust-Region behavior Blending (Qwen3-1.7B-Base ← Qwen3-8B)2026-05-29
LastOPD: Taming Collapse in Latent On-Policy Distillation✓ Link4.58LastOPD (Qwen3-8B -> Qwen3-1.7B-Base)2026-09-23
SLPO: Scaling Latent Reasoning via a Surrogate Policy✓ Link3.33SLPO (Llama-3.2-3B-Instruct)2026-07-22
Mid-Training with Self-Generated Data Improves Reinforcement Learning in Language Models0.44Llama 3.2–3B–Instruct (mid-trained, n=64)2026-05-08