Advancing State of the Art in Language Modeling

Benchmark Model Rank Results
language-modelling-on-penn-treebank-wordEnsemble of All#9Test perplexity: 47.31Validation perplexity: 48.92
language-modelling-on-wikitext-103Ensemble of All#7Test perplexity: 13.29Validation perplexity: 13.11
language-modelling-on-wikitext-2Ensemble of All#20Test perplexity: 53.73Validation perplexity: 55.4