Understanding Evolution Strategies for LLM Reasoning: Broader Reasoning Coverage than GRPO

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kQwen2.5-7B-Instruct (GRPO to ES)–Accuracy: 92.3
code-generation-on-mbppQwen2.5-7B-Instruct (ES to GRPO)–Accuracy: 75.2
mathematical-reasoning-on-aime-2025DeepSeek-R1-Distill-Qwen-1.5B (GRPO to ES)–Accuracy: 24.5
mathematical-reasoning-on-aime24DeepSeek-R1-Distill-Qwen-1.5B (ES to GRPO)–Acc: 29.0
mathematical-reasoning-on-amc23DeepSeek-R1-Distill-Qwen-1.5B (ES to GRPO)–Acc: 72.3
mathematical-reasoning-on-math-500DeepSeek-R1-Distill-Qwen-1.5B (GRPO to ES)–Accuracy: 84.5
multiple-choice-question-answering-mcqa-on-gpqa-diamondDeepSeek-R1-Distill-Qwen-1.5B (GRPO to ES)–Accuracy: 30.6