| Benchmark | Model | Rank | Results |
|---|---|---|---|
| common-sense-reasoning-on-arc-easy | Isotropic KDN (1.3B) | #36 | Accuracy: 74.71 |
| language-modelling-on-lambada | Diagonal KDN + SWA (1.3B) | #41 | Accuracy: 51.99 |
| language-modelling-on-lambada | Diagonal KDN (1.3B) | #78 | Perplexity: 9.75 |
| question-answering-on-natural-questions | Diagonal KDN (1.3B) | #55 | EM: 23.63 |
| common-sense-reasoning-on-winogrande | Isotropic KDN (1.3B) | #110 | Accuracy: 61.33 |
| question-answering-on-piqa | Diagonal KDN (1.3B) | #120 | Accuracy: 74.21 |
| sentence-completion-on-hellaswag | Diagonal KDN (1.3B) | #147 | Accuracy: 60.68 |