OpenCodePapers

mathematical-reasoning-on-math-500

Mathematical Reasoning
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Efficient Agentic Reasoning Through Self-Regulated Simulative Planning✓ Link99.2SR 2 AM-v1.0-30B2026-05-21
Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone✓ Link99.20Ternary Bonsai 27B2026-07-14
Unlocking Lossless Speedups in LLMs via Discrete Diffusion✓ Link98.9Uno (K2-Horizon-7B-Uno)2026-09-03
Learning More by Training Less: Uncertainty-Guided Progressive Contraction for Efficient Reasoning Post-Training✓ Link98.6Qwen3.5-9B (rho=30%)2026-10-09
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link98.2GLM-4.5 (355B)2025-08-08
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link98.1GLM-4.5-Air2025-08-08
Qwen3 Technical Report✓ Link98.0Qwen3-235B-A22B (Thinking)2025-05-14
JudgeRLVR: Judge First, Generate Second for Efficient Reasoning98.0Vanilla RLVR (Qwen3-30B-A3B)2026-01-13
Introspective Diffusion Language Models✓ Link97.6I-DLM (32B)2026-04-13
CopT: Contrastive On-Policy Thinking with Continuous Spaces for General and Agentic Reasoning✓ Link97.6CopT (Qwen3-8B)2026-05-19
Kimi K2: Open Agentic Intelligence✓ Link97.4Kimi K22025-07-28
Falcon-H1R: Pushing the Reasoning Frontiers with a Hybrid Model for Efficient Test-Time Scaling✓ Link97.4Falcon-H1R (7B)2026-01-05
ThoughtFold: Folding Reasoning Chains via Introspective Preference Learning✓ Link97.4ThoughtFold (Qwen3-8B)2026-06-02
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning✓ Link97.3DeepSeek-R12025-01-22
Recursive Think-Answer Process for LLMs and VLMs97.3MiMo-RL-7B-R-TAP2026-03-02
One Model to Loop Them All: Elastic Latent Recurrence for Language Models97.2Koi-4B2026-10-08
ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search✓ Link97.13ZGCM-12026-09-11
On-Policy Self-Distillation without Any Supervision✓ Link97.0u-OPSD Qwen3-30B-A3B-Instruct-25072026-08-09
A*-Thought-V2: Efficient Latent Reasoning via Geometric Dynamics of LLM✓ Link97.0A*-Thought-V2 (Qwen3.5-9B, tau=60)2026-09-07
Rethinking Sample Polarity in Reinforcement Learning with Verifiable Rewards96.9A3PO (Deepseek-R1-Distill-Qwen-7B)2025-12-25
Scaling Embeddings Outperforms Scaling Experts in Language Models96.8LongCat-Flash-Lite (68.5B)2026-01-29
iGRPO: Self-Feedback-Driven LLM Reasoning96.7OpenMath-Nemotron-14B + iGRPO2026-02-09
ERNIE 4.5 Technical Report✓ Link96.4ERNIE-4.5-300B-A47B2025-06-30
LongCat-Flash Technical Report✓ Link96.40LongCat-Flash2025-09-01
SFT Conflicts, RL Coexists: A Theoretical and Empirical Analysis of Multi-Task Learning for LLMs✓ Link96.2Adapted Parallel-RL (DeepSeek-R1-Distill-Qwen-7B)2026-08-06
LFM2.5-24B-A2B: Built for Fast On-Device Agents96.04LFM2.5-24B-A2B2026-10-13
CoDiQ: Test-Time Scaling for Controllable Difficult Question Generation✓ Link96.0CoDiQ-L3-4B2026-02-02
EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modes✓ Link95.8EXAONE 4.0 32B (Reasoning)2025-07-15
Calibrating Teacher--Student Discrepancy for On-Policy Distillation95.8Cal-OPD (Qwen3-30B-A3B-Thinking-2507 -> Qwen3-4B)2026-09-18
Nanbeige4-3B Technical Report: Exploring the Frontier of Small Language Models✓ Link95.5Nanbeige4-3B-Base + Ring-Lite SFT (extra data)2025-12-06
Self-Hinting Language Models Enhance Reinforcement Learning✓ Link95.4SAGE (Qwen3-4B-Instruct)2026-02-03
Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models95.4DS-R1-Distill-Qwen-7B + OPD Dynamic Sampling2026-08-17
TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs✓ Link95.3TGRL (Qwen3-14B) (extra data)2026-09-27
Efficient Reasoning with Balanced Thinking✓ Link95.2ReBalance (QwQ-32B)2026-03-12
Post-Trained MoE Can Skip Half Experts via Self-Distillation✓ Link95.2ZEDA (Qwen3-30B-A3B)2026-05-18
Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning✓ Link95.2ACTS (Qwen3-8B)2026-06-02
Entropy Ratio Clipping as a Soft Global Constraint for Stable Reinforcement Learning95.1ERC-DAPO (DeepSeek-R1-Distill-Qwen-7B)2025-12-05
Rethinking Generalization in Reasoning SFT: A Conditional Analysis on Optimization, Data, and Model Capability✓ Link95.1Qwen3-14B (Math-CoT SFT)2026-04-08
Figure It Out: Improving the Frontier of Reasoning with Active Visual Thinking✓ Link95.0FigR2025-12-30
Efficient Reasoning on the Edge95.0Qwen2.5-7B-Instruct (OT3, dense)2026-03-17
Revisiting Complete Reasoning Traces for Post-Training✓ Link95Qwen2.5-32B-Instruct + segment SFT (s1K-1.1, Prefix)2026-09-07
Heterogeneous Agent Collaborative Reinforcement Learning94.8Qwen3-4B-Instruct (HACPO)2026-03-03
Distilling Long-CoT Reasoning through Collaborative Step-wise Multi-Teacher Decoding✓ Link94.8R1-Qwen (32B) with CoRD (heterogeneous teachers)2026-05-04
Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation✓ Link94.69FiRe-OPD2026-06-01
OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization✓ Link94.66OSCAR (GLM-4.7, 358B)2026-05-18
Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Math94.6Phi-4-Mini-Reasoning2025-04-30
Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment✓ Link94.6Qwen-3-14B (fine-tuned with Rank-Surprisal Ratio selection)2026-01-20
MiniCPM5-2B✓ Link94.6MiniCPM5-2B2026-09-07
Co-Evolving Policy Distillation94.5CoPD2026-04-29
Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models✓ Link94.2Qwen3-30B-A3B-Thinking with PUMA2026-05-17
JustRL: Scaling a 1.5B LLM with a Simple RL Recipe✓ Link94.15JustRL-Nemotron 1.5B2025-12-18
InftyThink+: Effective and Efficient Infinite-Horizon Reasoning via Reinforcement Learning✓ Link94.09InftyThink+ (Qwen3-4B-Base, task-only RL)2026-02-06
PACED: Distillation at the Frontier of Student Competence94.0Paced Forward KL (Qwen3-8B)2026-03-11
HyperCLOVA X THINK Technical Report✓ Link93.8HyperCLOVA X SEED 14B Think2025-06-27
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models✓ Link93.7Youtu-LLM 2B2025-12-31
Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning✓ Link93.6NPR (Qwen3-4B-Instruct-2507)2025-12-08
FlowBalance: Verifier-Grounded Self-Improvement from On-Policy Reasoning Experience✓ Link93.52Qwen3-8B + FlowBalance2026-09-03
IIB-LPO: Latent Policy Optimization via Iterative Information Bottleneck93.5I2B-LPO (Qwen3-14B)2026-01-09
Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models93.4MELT-1.6B2026-05-08
Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability✓ Link93.0ThinkPrune (Qwen3-4B)2026-10-02
ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning✓ Link92.7ResRL (Qwen3-8B)2026-05-01
The Past Is Not Past: Memory-Enhanced Dynamic Reward Shaping✓ Link92.51Qwen3-8B + MEDS2026-04-13
Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation✓ Link92.4OPDLM-MATH-8B-Thinking2026-06-04
TPPO: Tracking-Value PPO For Language Model Reasoning✓ Link92.3TPPO (Qwen3-4B)2026-10-12
LEAD: Length-Efficient Adaptive and Dynamic Reasoning for Large Language Models✓ Link92.27LEAD (DeepSeek-R1-Distill-Qwen-7B)2026-05-10
GRAIL: Gradient-Reweighted Advantages for Reinforcement Learning with Verifiable Rewards✓ Link92.07GRAIL (Qwen3-8B)2026-06-03
On-Policy Distillation with Negative-Policy Rollouts✓ Link91.8Qwen3-8B + NP-OPD (OPD 2, alpha=0.5, thinking mode)2026-10-06
MiniCPM5-1B✓ Link91.6MiniCPM5-1B (Thinking)2026-05-25
TRIAGE: Direction-Aware Mismatch Stabilization of Native NVFP4 Reinforcement Learning✓ Link91.6Qwen3-30B-A3B-Base (NVFP4+TRIAGE, step 1700)2026-10-05
ThreadWeaver: Adaptive Threading for Efficient Parallel Reasoning in Language Models✓ Link91.4ThreadWeaver (Qwen3-8B)2025-11-24
LYNX: Learning Dynamic Exits for Confidence-Controlled Reasoning✓ Link91.4LYNX (QwQ-32B)2025-12-05
Qwen3 Technical Report✓ Link91.2Qwen3-235B-A22B (Non-thinking)2025-05-14
Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?✓ Link90.93DeepSeek-R1-Distill-Qwen-7B (SFT on D_ug)2026-03-25
TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning90.7TERMINATOR (Qwen3-8B)2026-03-13
Towards Full Pipeline FP8 Reinforcement Learning for LLMs90.7Qwen3-8B-Base + Calibrated Clipping (Blockwise FP8)2026-09-19
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs✓ Link90.4Phi-4-Mini reasoning2025-02-24
From P(y|x) to P(y): Investigating Reinforcement Learning in Pre-train Space✓ Link90.31DSRL (Qwen3-8B)2026-04-15
DeepSeek-V3 Technical Report✓ Link90.2DeepSeek-V32024-12-27
On the Off-Policy Teacher in On-Policy Distillation90.0SCOUT2026-09-29
Recovering Reliable Supervision via Critique-Guided On-Policy Distillation✓ Link89.08CriticOPD (Olmo-3-7B-Instruct-SFT)2026-10-14
LFM2.5-8B-A1B: an Even Better on-Device Mixture-of-Experts✓ Link88.76LFM2.5-8B-A1B2026-05-28
DenoiseRL: Bootstrapping Reasoning Models to Recover from Noisy Prefixes✓ Link88.2DenoiseRL-DAPO (Qwen3-8B-Base)2026-05-27
Agentic Critical Training87.73ACT (Qwen3-8B)2026-03-09
Rectifying LLM Thought from Lens of Optimization✓ Link87.7DeepSeek-R1-Distill-Qwen-1.5B with PPO+RePro2025-12-01
KV4-RL: Unlocking Faster Asynchronous Rollouts for RLVR with INT4 KV Cache Quantization87.7KV4-RL (Qwen3-8B-Base)2026-10-10
LFM-1B-Math: Can Small Models Be Concise Reasoners?87.48LFM-1.3B-Distill (32K output budget)2025-06-24
ESPO: Early-Stopping Proximal Policy Optimization87.42ESPO (DeepSeek-R1-Distill-Qwen-7B)2026-05-28
NGM: A Plug-and-Play Training-Free Memory Module for LLMs✓ Link87.0Qwen3-14B + NGM2026-05-16
Selection Is Not Learning: Choosing Model Futures86.87EvoHeir (Gemma-4-E4B-it)2026-10-15
On-Policy Self-Distillation for Reasoning Compression✓ Link86.6Qwen3-8B (OPSDC)2026-03-05
Unsupervised Process Reward Models86.5uPRM2026-05-11
ReSPO: Reshaped Sequence Policy Optimization for Gradient Starvation in Off-Policy Learning✓ Link85.7ReSPO (Qwen3-30B-A3B-Base, N=16)2026-09-28
ASI-Evolve: AI Accelerates AI✓ Link85.6Algorithm1 (ASI-Evolve)2026-03-31
SpecFold: Folding Multi-Branch Redundancy for Faster Speculative Decoding in Diffusion Language Models✓ Link85.6SpecFold (Nemotron-Labs-Diffusion-14B)2026-10-06
Group Adaptive Clipping Policy Optimization✓ Link85.5DeepSeek-R1-Distill-Qwen-1.5B + GAPO2026-08-31
SPARK: Stepwise Process-Aware Rewards for Reference-Free Reinforcement Learning85.4PRM-CoT (Process-Aware) (Qwen2.5-Math-7B)2025-12-02
MixSD: Mixed Contextual Self-Distillation for Knowledge Injection85.4Qwen3-8B with MixSD (lambda=0.7)2026-05-16
Can LLMs Learn to Reason Robustly under Noisy Supervision?✓ Link85.2Qwen3-4B-Base (with OLR)2026-04-05
DiRL: An Efficient Post-Training Framework for Diffusion Language Models✓ Link85.1DiRL-8B-Instruct2025-12-23
Beyond the Stability-Exploration Dilemma: Environmental Regularization for LLM Policy Optimization85.0ERPO (Qwen2.5-32B)2026-08-24
RISE: Recursive Improvement via Self-Extrapolating Policy Distillation84.9RISE (weight,Qwen3-8B,3-seedmean)2026-09-04
dots.llm1 Technical Report✓ Link84.8dots.llm1.inst2025-06-06
On-policy Distillation with Verifiable Reward✓ Link84.7OPDVR (Qwen3-4B)2026-08-25
OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification84.61OmniOPD (Qwen3-1.7B student, Qwen3-32B teacher)2026-05-31
TraPO: A Semi-Supervised Reinforcement Learning Framework for Boosting LLM Reasoning✓ Link84.6Qwen2.5-Math-7B with TraPO (4K labels, 12K unlabeled)2025-12-15
Unlocking Token Rewards via Training-Free Reward Attribution84.5Qwen2.5-Math-7B + GRPO (P2T token reward) (extra data)2026-06-03
Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO84.5DeepSeek-R1-Distill-Qwen-1.5B (GRPO to ES)2026-08-27
Normalized Low-Rank Adaptation✓ Link84.5DS-R1-Distill-Qwen1.5B NoRA2026-08-31
SCALER:Synthetic Scalable Adaptive Learning Environment for Reasoning✓ Link84.4Qwen3-4B-base + SCALER2026-01-08
Beyond Stochastic Exploration: What Makes Training Data Valuable for Agentic Search✓ Link84.2GRPO + HiExp (Qwen2.5-Math-7B)2026-04-09
Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance✓ Link83.80Falcon-H1-34B-Instruct2025-07-30
J-Zero: Unified Challenger--Solver--Judge Co-Evolution from Zero Data✓ Link83.4J-Zero-8B2026-08-27
Long Live The Balance: Information Bottleneck Driven Tree-based Policy Optimization✓ Link83.3IBTPO (Qwen3-8B-Base)2026-05-27
When Reasoning Meets Its Laws✓ Link83.0DeepSeek-R1-8B (SFT-Compo)2025-12-19
ProFit: Leveraging High-Value Signals in SFT via Probability-Guided Token Selection✓ Link82.85ProFit (Qwen3-14B-Base)2026-01-14
Your Group-Relative Advantage Is Biased82.8DAPO+HA-DW (Qwen-3-8B-Base)2026-01-13
Solving Physics Olympiad via Reinforcement Learning on Physics Simulators✓ Link82.8Qwen2.5-32B + RL (synthetic)2026-04-13
PRISM: Demystifying Retention and Interaction in Mid-Training82.73Granite-4-H Micro (3B) PRISM2026-03-17
Guided Self-Evolving LLMs with Minimal Human Supervision82.6Qwen3-8B-Base (R-Few 5%)2025-12-02
Enabling Token-wise Importance Sampling in Off-Policy RLVR with Proximal KL Regularization✓ Link82.4Proximal KL (Qwen3-4B-Base, off-policy, staleness 4, lr 5e-6)2026-10-13
Claude 3.7 Sonnet and Claude Code82.2Claude 3.7 Sonnet2025-02-24
Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes✓ Link82.0Local Support Matching (Qwen2.5-7B-Instruct, unmasked)2026-03-26
PretrainZero: Reinforcement Active Pretraining81.9PretrainZero (Qwen3-8B-Base)2025-12-03
Learning to Hint for Reinforcement Learning✓ Link81.8HiLL (Qwen2.5-7B-Instruct)2026-04-01
Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution✓ Link81.25OPPD (Qwen2.5-Math-7B, seed 2)2026-10-05
Branching On-Policy Distillation81.24BranchOPD (extra data)2026-10-09
Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance✓ Link81.1FEST-GRPO2026-05-14
HalluGuard: Demystifying Data-Driven and Reasoning-Driven Hallucinations in LLMs81.0HalluGuard (Qwen2.5-Math-7B)2026-01-26
APPO: Agentic Procedural Policy Optimization✓ Link81.0APPO (Qwen2.5-7B-Instruct)2026-06-10
Can LLMs Guide Their Own Exploration? Gradient-Guided Reinforcement Learning for LLM Reasoning80.8G2RL (Qwen3-4B-Base)2025-12-17
ALoDLM: Adaptively Looped Diffusion Language Models✓ Link80.8ALoDLM-8B2026-10-03
nabla-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space✓ Link80.4∇-Reasoner (Qwen-2.5-7B-Instruct)2026-03-05
Graph-Based Chain-of-Thought Pruning for Reducing Redundant Reflections in Reasoning LLMs80.4DeepSeek-R1-Distill-Qwen-1.5B (Graph-based CoT Pruning)2026-04-07
Guiding LLM Post-training Data Engineering with Model Internals from Sparse Autoencoders80.3Qwen2.5-Math-7B (SaeRL, GRPO)2026-05-26
SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation✓ Link79.88SPOT Qwen3-4B-Base2026-08-05
Label-free steering: Compressing test-time reinforcement learning into bias-only subspaces✓ Link79.5Qwen2.5-Math-7B + Label-Free Bias-Only TTRL2026-09-28
Demystifying Hidden-State Recurrence: Switchable Latent Reasoning with On-Policy Reinforcement Learning79.3Switch (ours, after Switch-GRPO)2026-06-11
Stabilizing Reinforcement Learning for Diffusion Language Models✓ Link79.2StableDRL (SDAR-8B, static sampling)2026-03-06
Multi-Block Diffusion Language Models✓ Link79.2MBD-LLaDA2-Mini2026-06-30
TIP: Token Importance in On-Policy Distillation✓ Link79.1TIP Soft-OR 50% (Qwen3-8B → Qwen3-4B)2026-04-15
Length-Unbiased Sequence Policy Optimization: Revealing and Controlling Response Length Variation in RLVR✓ Link78.4Qwen2.5-7B-Base (LUSPO)2026-02-05
Geometry Conflict: Explaining and Controlling Forgetting in LLM Continual Post-Training✓ Link78.2Qwen3-14B with GCWM2026-05-10
Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge✓ Link78.0Multiplex Thinking (DeepSeek-R1-Distill-Qwen-7B)2026-01-13
CLIPO: Contrastive Learning in Policy Optimization Generalizes RLVR✓ Link77.87GMPO + CLIPO2026-03-10
The Molecular Structure of Thought: Mapping the Topology of Long Chain-of-Thought Reasoning77.8Qwen-2.5-7B-Instruct + 20K OSS-Mole-Syn2026-01-09
Residual Context Diffusion Language Models✓ Link77.6SDAR (8B, b=32) with RCD2026-01-30
MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction✓ Link77.0MiniCPM-o 4.5-Instruct2026-04-30
The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents76.9Qwen2.5-3B with CAR (MSCR)2026-01-12
From Imitation to Discrimination: Toward A Generalized Curriculum Advantage Mechanism Enhancing Cross-Domain Reasoning Tasks76.8GRPO (with CAPO) (Qwen2.5-7B-Math)2025-12-02
Difficulty-Adaptive Tree-Structured Policy Optimization for Expanding Reasoning Coverage in RLVR✓ Link76.4DATPO (Qwen3-4B-Base)2026-09-08
Think Again or Think Longer? Selective Verification for Budget-Aware Reasoning✓ Link76.3Selective active verify (Qwen3-1.7B gate)2026-06-18
Coupled Variational Reinforcement Learning for Language Model General Reasoning✓ Link76.1Qwen3-14B with CoVRL2025-12-14
Representation-Space MMD for Diffusion Language Models✓ Link76.0DMax-Math-MMD2026-10-05
Weak-Driven Learning: How Weak Agents make Strong Agents Stronger✓ Link75.4WMSS (Qwen3-8B-Base)2026-02-09
DMax: Aggressive Parallel Decoding for dLLMs✓ Link75.4DMax-Math2026-04-09
Co-RL: Unsupervised Reasoning Emerges from Diverse Cohort in Multi-agent RL✓ Link75.2Co-RL (Qwen2.5-7B, Different family)2026-08-19
Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning75.1Qwen2.5-Math-7B + ACE-DAPO2026-02-24
daVinci-Env: Open SWE Environment Synthesis at Scale✓ Link72.6OpenSWE-72B (Qwen2.5-72B-Base)2026-03-13
Reasoning Palette: Modulating Reasoning via Latent Contextualization for Controllable Exploration for (V)LMs72.2Qwen3-8B-Base with Reasoning Palette (RLOO, Linear Decay)2025-12-19
Rethinking RL for LLM Reasoning: It's Sparse Policy Selection, Not Capability Learning✓ Link70.6ReasonMaxxer (Qwen2.5-7B)2026-05-07
Learning User Preferences Through Interaction for Long-Term Collaboration✓ Link70.35gpt-oss-20b + memory2026-01-06
T3D: Few-Step Diffusion Language Models via Trajectory Self-Distillation with Direct Discriminative Optimization✓ Link70.0T3D (SDAR-4B-Chat)2026-02-12
Trust-Region Behavior Blending for On-Policy Distillation69.7Trust-Region behavior Blending (Qwen3-1.7B-Base ← Qwen3-8B)2026-05-29
FlashREINFORCE: Critic-Free Single-Rollout Asynchronous RL for Agentic Language Models✓ Link69.2FlashREINFORCE (Qwen2.5-Math-1.5B)2026-09-14
Learn What's Left, Not What's Mastered: Saturation Aware Advantage Reweighting for Multi-Reward Policy Optimization67.7Qwen2.5-7B-Instruct with SA-MRPO (3 objectives) (extra data)2026-08-17
HyperThink: Text-to-Parameter Hypernetworks for Efficient Reasoning67.36HyperThink (SmolLM3-3B) (extra data)2026-10-02
Dynamic Important Example Mining for Reinforcement Finetuning✓ Link65.9Qwen3-4B + DIEM2026-08-29
SkillFactory: Self-Distillation For Learning Cognitive Behaviors✓ Link64.6Qwen2.5-7B-Instruct (SkillFactory with 1k SFT + GRPO)2025-12-03
Multi-Stream LLMs: Unblocking Language Models with Parallel Streams of Thoughts, Inputs and Outputs✓ Link64.0Qwen3-4B (Stream)2026-05-12
Agon: Competitive Cross-Model RL with Implicit Rival Grading of Reasoning64.0Agon2026-07-08
Group Sequence Policy Optimization62.9AliceAI-T5-35B-A0.6B-Base2025-07-24
Smaller Models are Natural Explorers for Policy-Level Diversity in GRPO✓ Link62.74B→14B S2L2026-06-02
FROST: Filtering Reasoning Outliers with Attention for Efficient Reasoning✓ Link59.8Phi-4-Reasoning (FROST)2026-01-26
Composing What Each Teacher Learned: Multi-Teacher On-Policy Distillation through Teacher-Relative Shifts59.4Δ-MOPD (1.5B student)2026-10-07
LastOPD: Taming Collapse in Latent On-Policy Distillation✓ Link58.95LastOPD (Qwen3-4B -> Qwen3-1.7B-Base)2026-09-23
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs56.4NeuPAT (Qwen3-4B-Instruct-2507) (extra data)2026-08-08
Rationale-Guided Policy Optimization: Learning to Reason with Adaptive Rationale Scaffolding✓ Link55.2RGPO2026-10-05
Locally Confident, Globally Stuck: The Quality-Exploration Dilemma in Diffusion Language Models54.0WeDLM-8B (IMH)2026-04-01
From Gradients to Capabilities: Understanding Multi-Teacher On-Policy Distillation53.8SmolLM3-3B (PG/domain-response SGD)2026-10-01
Beyond Test-Time Training: Learning to Reason via Hardware-Efficient Optimal Control✓ Link52.8TTC-Net (Llama-3-Instruct-7B)2026-03-10
Who Should Lead Decoding Now? Tracking Reliable Trajectories for Ensembling Masked Diffusion Language Models48.6TIE (LLaDA + Dream; Token change count)2026-06-15
Self-Play Search Distillation for Large Language Model Reasoning46.8SPSD-Qwen3-4B-Base (OPSD)2026-09-25
The Flexibility Trap: Why Arbitrary Order Limits Reasoning Potential in Diffusion Language Models✓ Link45.2JustGRPO (LLaDA 8B Instruct)2026-01-21
SLPO: Scaling Latent Reasoning via a Surrogate Policy✓ Link45.0SLPO (Llama-3.2-3B-Instruct)2026-07-22
NCP-ArchPreview Technical Report: Moving towards Latent Space Language Models through Next Concept Prediction✓ Link43.91NCP-ArchPreview Stage-22026-09-09
BitNet b1.58 2B4T Technical Report✓ Link43.40BitNet b1.58 2B4T2025-04-16
Mid-Training with Self-Generated Data Improves Reinforcement Learning in Language Models38.11Llama 3.2–3B–Instruct (mid-trained, n=64)2026-05-08
Pivot-SD: Efficient Self-Distillation for Masked Diffusion Language Models✓ Link37.47Pivot-SD2026-10-02
C^2DLM: Causal Concept-Guided Diffusion Large Language Models✓ Link37.2C2DLM2025-11-27
Data Science and Technology Towards AGI Part I: Tiered Data Management✓ Link37.02MiniCPM-1.2B (Math-L3)2026-02-09
Beyond Hard Masks: Progressive Token Evolution for Diffusion Language Models✓ Link36.33EvoToken-DLM (LLaDA-Instruct-8B, 10k FT)2026-01-12
dLLM: Simple Diffusion Language Modeling✓ Link35.40LLaDA-Instruct (reasoning SFT)2026-02-26
Token-Level LLM Collaboration via FusionRoute33.0FusionRoute (Llama-3.1-8B)2026-01-08