Memory-Efficient Looped Transformer: Decoupling Compute from Memory in Looped Language Models

Benchmark Model Rank Results
code-generation-on-humanevalMELT-1.6B–Pass@1: 81.7
mathematical-reasoning-on-aime-2025MELT-1.6B–Accuracy: 33.3
mathematical-reasoning-on-aime-2026MELT-1.6B–Accuracy: 41.0
mathematical-reasoning-on-aime24MELT-1.6B–Acc: 46.7
mathematical-reasoning-on-math-500MELT-1.6B–Accuracy: 93.4
mathematical-reasoning-on-olympiadbenchMELT-1.6B–Accuracy: 64.7
question-answering-on-humanity-s-last-exam-hleMELT-1.6B–Accuracy: 2.0