The State-Prediction Separation Hypothesis

Benchmark Model Rank Results
zero-shot-question-answering-on-sciqSPS XL (LM Evaluation Harness)#6Accuracy: 87.5
language-modelling-on-lambadaSPS XL#48Accuracy: 49.5
common-sense-reasoning-on-arc-easySPS XL#72Accuracy: 66.3
question-answering-on-piqaSPS XL#146Accuracy: 71.9
sentence-completion-on-hellaswagSPS XL#163Accuracy: 56.3