Rethinking Critic Learning in PPO: Understanding and Mitigating Value Flattening

Benchmark Model Rank Results
mathematical-reasoning-on-minerva-mathSP3O Qwen3-4B-Base#13Accuracy: 47.93
mathematical-reasoning-on-olympiadbenchSP3O Qwen3-8B-Base#21Accuracy: 54.5