| Benchmark | Model | Rank | Results |
|---|---|---|---|
| arithmetic-reasoning-on-gsm8k | code-davinci-002 175B (LEVER, 8-shot) | #34 | Accuracy: 84.5Parameters (Billion): 175 |
| code-generation-on-mbpp | code-davinci-002 175B + LEVER | #22 | Accuracy: 68.9 |
| semantic-parsing-on-spider | code-davinci-002 175B (LEVER) | #2 | Accuracy: 81.9 |
| semantic-parsing-on-wikitablequestions | LEVER | #10 | Accuracy (Test): 65.8Accuracy (Dev): 64.6 |
| text-to-sql-on-spider | code-davinci-002 175B (LEVER) | #14 | Execution Accuracy (Dev): 81.9 |