Trust Region On-Policy Distillation

Benchmark Model Rank Results
code-generation-on-livecodebench-v6TrOPD (Qwen3-SFT-1.7B)–Pass@1: 36.0
instruction-following-on-ifbenchTrOPD (Qwen3-SFT-1.7B)–Accuracy: 42.18
mathematical-reasoning-on-aime-2025TrOPD (Qwen3-SFT-1.7B)–Accuracy: 44.06
mathematical-reasoning-on-aime24TrOPD (Qwen3-SFT-1.7B)–Acc: 52.08
multiple-choice-question-answering-mcqa-on-gpqa-diamondTrOPD (DeepSeek-R1-Distill-Qwen-1.5B)–Accuracy: 36.24