xHC: Expanded Hyper-Connections
Open paper
Benchmark
Model
Rank
Results
multi-task-language-understanding-on-mmlu-pro
xHC (18B, pre-training only) with Muon
#128
Accuracy: 32.0
Rank counts only results with a code link.