Group Sequence Policy Optimization

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kAliceAI-T5-35B-A0.6B-Base–Accuracy: 84.7
code-generation-on-humanevalAliceAI-T5-35B-A0.6B-Base–Pass@1: 69.3
code-generation-on-mbppAliceAI-T5-35B-A0.6B-Base–Accuracy: 71.9
mathematical-reasoning-on-math-500AliceAI-T5-35B-A0.6B-Base–Accuracy: 62.9