| multiple-choice-question-answering-mcqa-on-arc-challenge-25-shot | Nemotron-4-340B-Base (25-shot) | #2 | Accuracy: 94.28 |
| common-sense-reasoning-on-winogrande | Nemotron-4-340B-Base | #6 | Accuracy: 89.50 |
| instruction-following-on-ifeval | Nemotron-4-340B-Instruct | #6 | Prompt-level strict-accuracy: 79.9 |
| instruction-following-on-mtbench | Nemotron-4-340B-Instruct | #11 | Score (1-10): 8.22 |
| sentence-completion-on-hellaswag | Nemotron-4-340B-Base | #15 | Accuracy: 90.53 |
| code-generation-on-mbpp | Nemotron-4-340B-Instruct | #43 | Accuracy: 75.4 |
| arithmetic-reasoning-on-gsm8k | Nemotron-4-340B-Instruct | #48 | Accuracy: 92.3 |
| code-generation-on-humaneval | Nemotron-4-340B-Instruct | #79 | Pass@1: 73.2 |