| math-word-problem-solving-on-math | Minerva 62B (maj5@256) | #43 | Accuracy: 64.9Parameters (Billions): 62 |
| math-word-problem-solving-on-math | Minerva 540B (maj1@k, k=64) | #85 | Accuracy: 50.3 |
| math-word-problem-solving-on-math | Minerva 8B (maj5@256) | #97 | Accuracy: 47.6Parameters (Billions): 8 |
| math-word-problem-solving-on-math | Minerva 62B (maj1@k, k=64) | #115 | Accuracy: 43.4Parameters (Billions): 62 |
| math-word-problem-solving-on-math | Minerva 540B | #129 | Accuracy: 33.6Parameters (Billions): 540 |
| math-word-problem-solving-on-math | Minerva 62B (4-shot) | #145 | Accuracy: 27.6Parameters (Billions): 62 |
| math-word-problem-solving-on-math | Minerva 8B (maj1@k, k=64) | #148 | Accuracy: 25.4Parameters (Billions): 8 |
| math-word-problem-solving-on-math | davinci-002 175B | #163 | Accuracy: 19.1Parameters (Billions): 175 |
| math-word-problem-solving-on-math | Minerva 8B | #169 | Accuracy: 14.1Parameters (Billions): 8 |
| math-word-problem-solving-on-math | PaLM 540B | #180 | Accuracy: 8.8Parameters (Billions): 540 |
| math-word-problem-solving-on-math | PaLM 8B (fine-tuned) | #190 | Accuracy: 5.6Parameters (Billions): 8 |
| math-word-problem-solving-on-math | PaLM 62B | #194 | Accuracy: 4.4Parameters (Billions): 62 |
| math-word-problem-solving-on-math | PaLM 8B | #199 | Accuracy: 1.5Parameters (Billions): 8 |
| arithmetic-reasoning-on-gsm8k | Minerva 62B (maj5@100) | #85 | Accuracy: 89Parameters (Billion): 62 |
| arithmetic-reasoning-on-gsm8k | Minerva 540B (CoT) | #166 | Accuracy: 78.5Parameters (Billion): 540 |
| arithmetic-reasoning-on-gsm8k | Minerva 62B (maj1@100) | #201 | Accuracy: 68.5Parameters (Billion): 62 |
| arithmetic-reasoning-on-gsm8k | Minerva 8B (maj5@100) | #221 | Accuracy: 56.8Parameters (Billion): 8 |
| arithmetic-reasoning-on-gsm8k | PaLM 540B (8-shot) | #223 | Accuracy: 56.5Parameters (Billion): 540 |
| arithmetic-reasoning-on-gsm8k | Minerva 62B (8-shot) | #231 | Accuracy: 52.4Parameters (Billion): 62 |
| arithmetic-reasoning-on-gsm8k | PaLM 62B (8-shot) | #256 | Accuracy: 33.0Parameters (Billion): 62 |
| arithmetic-reasoning-on-gsm8k | Minerva 8B-maj1@k (8-shot) | #260 | Accuracy: 28.4Parameters (Billion): 8 |
| arithmetic-reasoning-on-gsm8k | Minerva 8B (8-shot) | #269 | Accuracy: 16.2Parameters (Billion): 8 |
| arithmetic-reasoning-on-gsm8k | PaLM 8B (8-shot) | #278 | Accuracy: 4.1Parameters (Billion): 8 |