The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation

Benchmark Model Rank Results
mathematical-reasoning-on-aime24RIDE (Qwen3-4B -> Just-Qwen3-4B)#63Acc: 63.13
mathematical-reasoning-on-aime-2025RIDE (Qwen3-4B -> Just-Qwen3-4B)#81Accuracy: 52.92