Dynamic Evaluation of Neural Sequence Models

Benchmark Model Rank Results
language-modelling-on-hutter-prizemLSTM + dynamic eval#10Bit per Character (BPC): 1.08Number of params: 46M
language-modelling-on-penn-treebank-wordAWD-LSTM + dynamic eval#13Test perplexity: 51.1Validation perplexity: 51.6Params: 24M
language-modelling-on-text8mLSTM + dynamic eval#14Bit per Character (BPC): 1.19Number of params: 45M
language-modelling-on-wikitext-2AWD-LSTM + dynamic eval#17Test perplexity: 44.3Validation perplexity: 46.4Number of params: 33M