TinyGSM: achieving >80% on GSM8k with small language models
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
Phi-GSM 2.7B (fine-tuned)
–
Accuracy: 74.3
Parameters (Billion): 2.7
arithmetic-reasoning-on-gsm8k
Phi-GSM+V 1.3B+1.3B (verify48@1)
–
Accuracy: 81.5
Parameters (Billion): 2.6
Rank counts only results with a code link.