| Benchmark | Model | Rank | Results |
|---|---|---|---|
| question-answering-on-copa-zero-shot | PPT (k-Shuffle Dyck), 3B, Marin, 100B PT tokens | #3 | Accuracy: 85.0 |
| language-modelling-on-lambada | PPT (k-Shuffle Dyck), 3B, Marin, 100B PT tokens | #16 | Accuracy: 74.3 |
| reading-comprehension-on-race | PPT (k-Shuffle Dyck), 3B, C4, 100B PT tokens | #30 | Accuracy: 37.2 |
| question-answering-on-piqa | PPT (k-Shuffle Dyck), 3B, C4, 100B PT tokens | #87 | Accuracy: 77.1 |
| sentence-completion-on-hellaswag | PPT (k-Shuffle Dyck), 3B, C4, 100B PT tokens | #128 | Accuracy: 66.3 |