GPT-NeoX-20B: An Open-Source Autoregressive Language Model

Benchmark Model Rank Results
zero-shot-question-answering-on-sciqGPT-NeoX-20B (LM Evaluation Harness)#2Accuracy: 92.8
common-sense-reasoning-on-arc-easyGPT-NeoX-20B (5-shot)#37Accuracy: 74.6
multi-task-language-understanding-on-mmluGPT-NeoX 20B (5-shot)#81Average (%): 33.6
common-sense-reasoning-on-winograndeGPT-NeoX-20B (5-shot)#83Accuracy: 68.3
question-answering-on-piqaGPT-NeoX-20B (5-shot)#86Accuracy: 77.4
sentence-completion-on-hellaswagGPT-NeoX-20B (5-shot)#168Accuracy: 53.8