OVD: On-policy Verbal Distillation

Benchmark Model Rank Results
mathematical-reasoning-on-minerva-mathOVD (Qwen2.5-Math-1.5B, 2 random examples, 800 steps)–Accuracy: 18.0
mathematical-reasoning-on-olympiadbenchOVD (Qwen2.5-Math-1.5B, 2 random examples, 800 steps)–Accuracy: 31.6