Closing the Loop: Practical Training Recipes for Looped Language Models

Benchmark Model Rank Results
code-generation-on-scicodeDory1.0-4B–Accuracy: 35.11
code-generation-on-swe-bench-verifiedDory1.0-4B (NeMo Gym / Nemo Evaluator SDK)–Accuracy: 61.8
code-generation-on-terminal-bench-2-1Dory1.0-4B (Terminus-2)–Accuracy: 22.2
instruction-following-on-ifbenchDory1.0-4B–Accuracy: 79.0
multiple-choice-question-answering-mcqa-on-gpqa-diamondDory1.0-4B–Accuracy: 72.41