Trust-Region Behavior Blending for On-Policy Distillation

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kTrust-Region behavior Blending (Qwen3-0.6B-Base ← Qwen3-4B)–Accuracy: 70.1
mathematical-reasoning-on-aime-2025Trust-Region behavior Blending (Qwen3-1.7B-Base ← Qwen3-8B)–Accuracy: 6.9
mathematical-reasoning-on-aime24Trust-Region behavior Blending (Qwen3-1.7B-Base ← Qwen3-8B)–Acc: 10.2
mathematical-reasoning-on-math-500Trust-Region behavior Blending (Qwen3-1.7B-Base ← Qwen3-8B)–Accuracy: 69.7