Better Supervision Is Nearby: Neighborhood On-Policy Self-Distillation

Benchmark Model Rank Results
mathematical-reasoning-on-aime-2025N-OPSD (Qwen3-8B)–Accuracy: 72.78
mathematical-reasoning-on-aime24N-OPSD (Qwen3-8B)–Acc: 78.7
mathematical-reasoning-on-hmmt-feb-2025N-OPSD (Qwen3-8B)–Accuracy: 48.24