| language-modelling-on-the-pile | GPT-3 Davinci 175B (pre-trained) | #13 | Bits per byte: 0.7177 |
| language-modelling-on-the-pile | GPT-3 Curie 6.7B (pre-trained) | #18 | Bits per byte: 0.7980 |
| language-modelling-on-the-pile | GPT-3 Babbage 1.3B (pre-trained) | #22 | Bits per byte: 0.8718 |
| language-modelling-on-the-pile | GPT-3 Ada 350M (pre-trained) | #23 | Bits per byte: 0.9631 |
| language-modelling-on-the-pile | GPT-2 XL 1.5B (pre-trained) | #24 | Bits per byte: 1.0468 |
| language-modelling-on-the-pile | GPT-2 Large 774M (pre-trained) | #25 | Bits per byte: 1.0828 |
| language-modelling-on-the-pile | GPT-2 Medium 355M (pre-trained) | #26 | Bits per byte: 1.0928 |
| language-modelling-on-the-pile | GPT-2 Small 124M (pre-trained) | #27 | Bits per byte: 1.2253 |