Byte Latent Transformer: Patches Scale Better Than Tokens

Benchmark Model Rank Results
question-answering-on-piqaBLT-Space 8B#50Accuracy: 81.1
multi-task-language-understanding-on-mmluBLT-Entropy 8B (5-shot)#56Average (%): 57.4
sentence-completion-on-hellaswagBLT-Entropy 8B#71Accuracy: 80.6
code-generation-on-humanevalBLT-Entropy 8B#116Pass@1: 35.4
code-generation-on-mbppBLT-Entropy 8B (3-shot)#132Accuracy: 41.8