Solving math word problems with process- and outcome-based feedback

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kDeepMind 70B Model (SFT+ORM-RL, ORM reranking)–Accuracy: 87.3Parameters (Billion): 70
arithmetic-reasoning-on-gsm8kDeepMind 70B Model (SFT+PRM-RL, PRM reranking)–Accuracy: 87.1Parameters (Billion): 70
arithmetic-reasoning-on-gsm8kDeepMind 70B Model (STaR, maj1@96)–Accuracy: 76.5Parameters (Billion): 70