GPT-SW3: An Autoregressive Language Model for the Nordic Languages

Benchmark Model Rank Results
common-sense-reasoning-on-arc-easyGPT-SW3 40B–Accuracy: 68.7
common-sense-reasoning-on-winograndeGPT-SW3 40B–Accuracy: 65.6
question-answering-on-piqaGPT-SW3 40B–Accuracy: 77.2
sentence-completion-on-hellaswagGPT-SW3 40B–Accuracy: 53.2
zero-shot-question-answering-on-openbookqaGPT-SW3 40B–Accuracy: 27.4