| Benchmark | Model | Rank | Results |
|---|---|---|---|
| multi-task-language-understanding-on-mmlu | Huginn MoE (8.0B resident, 0.8B active) | #37 | Average (%): 66.81 |
| mathematical-reasoning-on-math-500 | Huginn MoE (8.0B resident, 0.8B active) | #123 | Accuracy: 53.4 |
| arithmetic-reasoning-on-gsm8k | Huginn MoE (8.0B resident, 0.8B active) | #135 | Accuracy: 83.62 |
| sentence-completion-on-hellaswag | Huginn MoE (8.0B resident, 0.8B active) | #165 | Accuracy: 55.1 |