MixSD: Mixed Contextual Self-Distillation for Knowledge Injection

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kQwen3-8B with MixSD (lambda=0.5)–Accuracy: 93.3
code-generation-on-humanevalQwen3-8B with MixSD (lambda=0.3)–Pass@1: 86
mathematical-reasoning-on-aime24Qwen3-8B with MixSD (lambda=0.7)–Acc: 32.1
mathematical-reasoning-on-math-500Qwen3-8B with MixSD (lambda=0.7)–Accuracy: 85.4