Can We Trust the Teacher? Decoupled Credit Direction-Magnitude for Self-Distillation

Benchmark Model Rank Results
mathematical-reasoning-on-aime-2025DCSD (Qwen3-4B)–Accuracy: 57.5
mathematical-reasoning-on-aime-2026DCSD (Qwen3-4B)–Accuracy: 59.17
mathematical-reasoning-on-aime24DCSD (Qwen3-4B)–Acc: 68.33
multimodal-reasoning-on-mathvisionDCSD (Qwen3-VL-8B-Instruct)–Accuracy: 54.11
multimodal-reasoning-on-mathvistaDCSD (Qwen3-VL-8B-Instruct)–Accuracy: 79.2
multimodal-reasoning-on-mmmuDCSD (Qwen3-VL-8B-Instruct)–Accuracy: 68.44