Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation

Benchmark Model Rank Results
instruction-following-on-ifbenchOpen-MOPD (SmolLM3-3B)#48Accuracy: 24.67
code-generation-on-livecodebench-v6Open-MOPD (SmolLM3-3B)#77Pass@1: 0.2263
mathematical-reasoning-on-aime24Open-MOPD (SmolLM3-3B)#114Acc: 21.98
mathematical-reasoning-on-aime-2025Open-MOPD (SmolLM3-3B)#123Accuracy: 22.86