DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving

Benchmark Model Rank Results
natural-questions-on-theoremqaDART-Math-DSMath-7B-Uniform (0-shot CoT, w/o code)#4Accuracy: 32.5
natural-questions-on-theoremqaDART-Math-DSMath-7B-Prop2Diff (0-shot CoT, w/o code)#5Accuracy: 32.2
natural-questions-on-theoremqaDART-Math-Llama3-70B-Prop2Diff (0-shot CoT, w/o code)#8Accuracy: 28.2
natural-questions-on-theoremqaDART-Math-Llama3-70B-Uniform (0-shot CoT, w/o code)#9Accuracy: 27.4
natural-questions-on-theoremqaDART-Math-Llama3-8B-Prop2Diff (0-shot CoT, w/o code)#16Accuracy: 19.4
natural-questions-on-theoremqaDART-Math-Mistral-7B-Prop2Diff (0-shot CoT, w/o code)#17Accuracy: 17.0
natural-questions-on-theoremqaDART-Math-Mistral-7B-Uniform (0-shot CoT, w/o code)#18Accuracy: 16.4
natural-questions-on-theoremqaDART-Math-Llama3-8B-Uniform (0-shot CoT, w/o code)#19Accuracy: 15.4
math-word-problem-solving-on-mathDART-Math-Llama3-70B-Prop2Diff (0-shot CoT, w/o code)#66Accuracy: 56.1Parameters (Billions): 70
math-word-problem-solving-on-mathDART-Math-Llama3-70B-Uniform (0-shot CoT, w/o code)#69Accuracy: 54.9Parameters (Billions): 70
math-word-problem-solving-on-mathDART-Math-DSMath-7B-Prop2Diff (0-shot CoT, w/o code)#74Accuracy: 53.6Parameters (Billions): 7
math-word-problem-solving-on-mathDART-Math-DSMath-7B-Uniform (0-shot CoT, w/o code)#76Accuracy: 52.9Parameters (Billions): 7
math-word-problem-solving-on-mathDART-Math-Llama3-8B-Prop2Diff (0-shot CoT, w/o code)#98Accuracy: 46.6Parameters (Billions): 8
math-word-problem-solving-on-mathDART-Math-Mistral-7B-Prop2Diff (0-shot CoT, w/o code)#103Accuracy: 45.5Parameters (Billions): 7
math-word-problem-solving-on-mathDART-Math-Llama3-8B-Uniform (0-shot CoT, w/o code)#104Accuracy: 45.3Parameters (Billions): 8
math-word-problem-solving-on-mathDART-Math-Mistral-7B-Uniform (0-shot CoT, w/o code)#114Accuracy: 43.5Parameters (Billions): 7
arithmetic-reasoning-on-gsm8kDART-Math-Llama3-70B-Uniform (0-shot CoT, w/o code)#71Accuracy: 90.4Parameters (Billion): 70
arithmetic-reasoning-on-gsm8kDART-Math-Llama3-70B-Prop2Diff (0-shot CoT, w/o code)#78Accuracy: 89.6Parameters (Billion): 70
arithmetic-reasoning-on-gsm8kDART-Math-DSMath-7B-Uniform (0-shot CoT, w/o code)#93Accuracy: 88.2Parameters (Billion): 7
arithmetic-reasoning-on-gsm8kDART-Math-DSMath-7B-Prop2Diff (0-shot CoT, w/o code)#108Accuracy: 86.8Parameters (Billion): 7
arithmetic-reasoning-on-gsm8kDART-Math-Mistral-7B-Uniform (0-shot CoT, w/o code)#141Accuracy: 82.6Parameters (Billion): 7
arithmetic-reasoning-on-gsm8kDART-Math-Llama3-8B-Uniform (0-shot CoT, w/o code)#142Accuracy: 82.5Parameters (Billion): 8
arithmetic-reasoning-on-gsm8kDART-Math-Mistral-7B-Prop2Diff (0-shot CoT, w/o code)#152Accuracy: 81.1Parameters (Billion): 7
arithmetic-reasoning-on-gsm8kDART-Math-Llama3-8B-Prop2Diff (0-shot CoT, w/o code)#153Accuracy: 81.1Parameters (Billion): 8