Copy-Paste Language Models

Benchmark Model Rank Results
multiple-choice-question-answering-mcqa-on-arc-cCopy-Paste Language Model (1.7B, Hybrid 3:1)#14Accuracy: 41.55
multiple-choice-question-answering-mcqa-on-arc-eCopy-Paste Language Model (1.7B, Full)#14Accuracy: 68.1
language-modelling-on-lambadaCopy-Paste Language Model (1.7B, Full)#51Accuracy: 46.92
question-answering-on-piqaCopy-Paste Language Model (1.7B, Full)#109Accuracy: 74.86
common-sense-reasoning-on-winograndeCopy-Paste Language Model (1.7B, Hybrid 3:1)#121Accuracy: 59.59
code-generation-on-humanevalCopy-Paste Language Model (1.7B, Hybrid 3:1)#131Pass@1: 22.1
sentence-completion-on-hellaswagCopy-Paste Language Model (1.7B, SW-256)#144Accuracy: 61.78
code-generation-on-mbppCopy-Paste Language Model (1.7B, SW-256)#160Accuracy: 20.8
math-word-problem-solving-on-mathCopy-Paste Language Model (1.7B, Full)#162Accuracy: 17.5
arithmetic-reasoning-on-gsm8kCopy-Paste Language Model (1.7B, Full)#246Accuracy: 33.1