mHC: Manifold-Constrained Hyper-Connections

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kmHC (27B)–Accuracy: 53.8
math-word-problem-solving-on-mathmHC (27B)–Accuracy: 26.0
question-answering-on-piqamHC (27B)–Accuracy: 80.5
sentence-completion-on-hellaswagmHC (27B)–Accuracy: 74.7