Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
Open paper
Benchmark
Model
Rank
Results
mathematical-reasoning-on-aime-2025
R1-Distill-1.5B + Top-16 OPD
#109
Accuracy: 33.8
Rank counts only results with a code link.