Off-the-Shelf LLMs as Process Scorers: Training-Free Alternative to PRMs for Mathematical Reasoning

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kCGS (Qwen2.5-1.5B โ†’ Qwen2.5-32B)–Accuracy: 92.5
mathematical-reasoning-on-aime24CGS (Qwen2.5-7B โ†’ Qwen2.5-72B)–Acc: 15.6
mathematical-reasoning-on-minerva-mathCGS (Qwen2.5-7B โ†’ Qwen2.5-72B)–Accuracy: 63.6