Distillation Defenses Easily Break After Reinforcement Learning
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
Qwen2.5-Math-7B (Distill) (extra data)
–
Accuracy: 89.0
Rank counts only results with a code link.