Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Benchmark Model Rank Results
language-modelling-on-wikitext-103Megatron-LM#3Test perplexity: 10.81Number of params: 8300M
question-answering-on-piqaMT-NLG 530B (0-shot)#22Accuracy: 82.0
reading-comprehension-on-raceMegatron-BERT (ensemble)#1Accuracy: 90.9Accuracy (Middle): 93.1Accuracy (High): 90.0
reading-comprehension-on-raceMegatron-BERT#3Accuracy: 89.5Accuracy (Middle): 91.8Accuracy (High): 88.6