Anti-Self-Distillation for Reasoning RL via Pointwise Mutual Information

Benchmark Model Rank Results
mathematical-reasoning-on-minerva-mathQwen3-30B-A3B + AntiSD#11Accuracy: 49.7
mathematical-reasoning-on-hmmt-feb-2025Olmo3-7B-TK + AntiSD#12Accuracy: 56.2
mathematical-reasoning-on-aime-2026Olmo3-7B-TK + AntiSD#32Accuracy: 76.1
mathematical-reasoning-on-aime24Qwen3-30B-A3B + AntiSD#35Acc: 79.4
mathematical-reasoning-on-aime-2025Qwen3-30B-A3B + AntiSD#45Accuracy: 75.6