Rethinking Generalization in Reasoning SFT: A Conditional Analysis on Optimization, Data, and Model Capability

Benchmark Model Rank Results
mathematical-reasoning-on-math-500Qwen3-14B (Math-CoT SFT)#28Accuracy: 95.1
mathematical-reasoning-on-aime24Qwen3-14B (Math-CoT SFT)#57Acc: 66.0
multi-task-language-understanding-on-mmlu-proQwen3-14B (Math-CoT SFT)#57Accuracy: 74.4
multiple-choice-question-answering-mcqa-on-gpqa-diamondQwen3-14B (Math-CoT SFT)#91Accuracy: 63.3