GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow

Benchmark Model Rank Results
language-modelling-on-wikitext-103GPT-Neo 2.7B#5Test perplexity: 11.39
question-answering-on-pubmedqaGPT-Neo 2.7B#31Accuracy: 57.54
language-modelling-on-lambadaGPT-Neo 2.7B#34Accuracy: 62.22Perplexity: 5.626
common-sense-reasoning-on-winograndeGPT-Neo 2.7B#140Accuracy: 56.50
question-answering-on-piqaGPT-Neo 2.7B#141Accuracy: 72.14
sentence-completion-on-hellaswagGPT-Neo 2.7B#194Accuracy: 42.73