On-Policy Self-Distillation for Reasoning Compression

Benchmark Model Rank Results
mathematical-reasoning-on-aime24OPSDC (Qwen3-14B, 30K budget)#40Acc: 76.3
mathematical-reasoning-on-math-500Qwen3-8B (OPSDC)#65Accuracy: 86.6
mathematical-reasoning-on-aime-2025Qwen3-14B (OPSDC)#66Accuracy: 61.7