| Benchmark | Model | Rank | Results |
|---|---|---|---|
| language-modelling-on-wikitext-103 | Megatron-LM | #3 | Test perplexity: 10.81Number of params: 8300M |
| question-answering-on-piqa | MT-NLG 530B (0-shot) | #22 | Accuracy: 82.0 |
| reading-comprehension-on-race | Megatron-BERT (ensemble) | #1 | Accuracy: 90.9Accuracy (Middle): 93.1Accuracy (High): 90.0 |
| reading-comprehension-on-race | Megatron-BERT | #3 | Accuracy: 89.5Accuracy (Middle): 91.8Accuracy (High): 88.6 |