| zero-shot-question-answering-on-truthfulqa-mc2-0-shot | Sumi-7B | #3 | MC2Acc: 46.6 |
| reading-comprehension-on-race | Sumi-7B | #28 | Accuracy: 41.4 |
| common-sense-reasoning-on-arc-easy | Sumi-7B | #55 | Accuracy: 70.0 |
| multi-task-language-understanding-on-mmlu | Sumi-7B (5-shot) | #63 | Average (%): 51.1 |
| common-sense-reasoning-on-winogrande | Sumi-7B (5-shot) | #117 | Accuracy: 60.0 |
| code-generation-on-humaneval | Sumi-7B | #130 | Pass@1: 22.6 |
| sentence-completion-on-hellaswag | Sumi-7B | #151 | Accuracy: 60.0 |
| code-generation-on-mbpp | Sumi-7B (3-shot) | #154 | Accuracy: 26.6 |
| question-answering-on-piqa | Sumi-7B | #157 | Accuracy: 66.4 |
| arithmetic-reasoning-on-gsm8k | Sumi-7B (4-shot) | #248 | Accuracy: 32.8 |