| Benchmark | Model | Rank | Results |
|---|---|---|---|
| automated-theorem-proving-on-minif2f-test | LLEMMA-7b | #13 | cumulative: 26.2Pass@32: 26.2ITP: Lean |
| automated-theorem-proving-on-minif2f-test | LLEMMA-34b | #14 | cumulative: 25.8Pass@32: 25.8ITP: Lean |
| arithmetic-reasoning-on-gsm8k | Llemma 34B | #234 | Accuracy: 51.5Parameters (Billion): 34 |
| arithmetic-reasoning-on-gsm8k | Llemma 7B | #251 | Accuracy: 36.4Parameters (Billion): 7 |