Decoding Looped Transformers Better for (Almost) Free

Benchmark Model Rank Results
code-generation-on-humanevalLoopCD-Ouro-2.6B (adaptive)–Pass@1: 79.88
common-sense-reasoning-on-winograndeLoopCD-Ouro-2.6B (adaptive)–Accuracy: 72.31
multi-task-language-understanding-on-mmlu-proLoopCD-Ouro-2.6B (fixed)–Accuracy: 57.5
question-answering-on-piqaLoopCD-Ouro-2.6B (adaptive)–Accuracy: 80.69
sentence-completion-on-hellaswagLoopCD-Ouro-2.6B (adaptive)–Accuracy: 81.66