Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
Open paper
Benchmark
Model
Rank
Results
language-modelling-on-openwebtext
BD3-LMs
#6
eval_perplexity: 20.73
parameters: 131M
Rank counts only results with a code link.