Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations

Benchmark Model Rank Results
mathematical-reasoning-on-aime-2025Qwen3-1.7B (OPD+Clip)–Accuracy: 37.5
mathematical-reasoning-on-aime-2026Qwen3-1.7B (OPD+Clip)–Accuracy: 36.0
mathematical-reasoning-on-aime24Qwen3-1.7B (OPD+Clip)–Acc: 45.2