| multi-task-language-understanding-on-mmlu | Nemotron-H-56B-Base (5-shot) | #9 | Average (%): 84.2 |
| multi-task-language-understanding-on-mmlu | Nemotron-H-8B-Base (5-shot) | #24 | Average (%): 72.8 |
| zero-shot-question-answering-on-openbookqa | Nemotron-H-47B-Base | #9 | Accuracy: 48.8 |
| zero-shot-question-answering-on-openbookqa | Nemotron-H-8B-Base | #11 | Accuracy: 47.2 |
| common-sense-reasoning-on-winogrande | Nemotron-H-56B-Base (5-shot) | #15 | Accuracy: 84.5 |
| common-sense-reasoning-on-winogrande | Nemotron-H-8B-Base (5-shot) | #31 | Accuracy: 80.5 |
| question-answering-on-piqa | Nemotron-H-56B-Base | #18 | Accuracy: 85.0 |
| question-answering-on-piqa | Nemotron-H-8B-Base | #35 | Accuracy: 82.2 |
| sentence-completion-on-hellaswag | Nemotron-H-56B-Base (10-shot) | #19 | Accuracy: 89.0 |
| sentence-completion-on-hellaswag | Nemotron-H-8B-Base (10-shot) | #53 | Accuracy: 83.2 |
| arithmetic-reasoning-on-gsm8k | Nemotron-H-56B-Base (8-shot) | #38 | Accuracy: 93.7 |
| arithmetic-reasoning-on-gsm8k | Nemotron-H-8B-Base (8-shot) | #100 | Accuracy: 87.1 |
| code-generation-on-mbpp | Nemotron-H-56B-Base (3-shot) | #38 | Accuracy: 77.8 |
| code-generation-on-mbpp | Nemotron-H-8B-Base (3-shot) | #74 | Accuracy: 65.4 |
| math-word-problem-solving-on-math | Nemotron-H-56B-Base (4-shot) | #55 | Accuracy: 59.4 |
| math-word-problem-solving-on-math | Nemotron-H-8B-Base (4-shot) | #97 | Accuracy: 46.5 |
| multi-task-language-understanding-on-mmlu-pro | Nemotron-H-47B-Base (5-shot) | #91 | Accuracy: 61.8 |
| multi-task-language-understanding-on-mmlu-pro | Nemotron-H-8B-Base (5-shot) | #122 | Accuracy: 44.0 |
| code-generation-on-humaneval | Nemotron-H-47B-Base | #94 | Pass@1: 61 |
| code-generation-on-humaneval | Nemotron-H-8B-Base | #95 | Pass@1: 58.5 |