Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes
Open paper
Benchmark
Model
Rank
Results
mathematical-reasoning-on-math-500
Local Support Matching (Qwen2.5-7B-Instruct, unmasked)
#85
Accuracy: 82.0
Rank counts only results with a code link.