Training Language Models via Neural Cellular Automata

Benchmark Model Rank Results
code-generation-on-humanevalNCA-pretrained 1.6B#140Pass@1: 7.5
arithmetic-reasoning-on-gsm8kNCA-pretrained 1.6B#276Accuracy: 4.4