Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kVicuna (SYRELM)#104Accuracy: 35.2Parameters (Billion): 13
math-word-problem-solving-on-svampSYRELM (Vicuna 13B)#15Execution Accuracy: 56.65
math-word-problem-solving-on-svampSYRELM (GPT-J)#23Execution Accuracy: 40.1