LoopFormer: Elastic-Depth Looped Transformers for Latent Reasoning via Shortcut Modulation

Benchmark Model Rank Results
zero-shot-question-answering-on-openbookqaLoopFormer (3x8)#24Accuracy: 26.8
language-modelling-on-lambadaLoopFormer (3x8)#58Accuracy: 38.27
common-sense-reasoning-on-winograndeLoopFormer (3x4)#154Accuracy: 53.43
question-answering-on-piqaLoopFormer (3x8)#165Accuracy: 63.33
sentence-completion-on-hellaswagLoopFormer (3x8)#214Accuracy: 32.3