Mogrifier LSTM

Benchmark Model Rank Results
language-modelling-on-enwiki8Mogrifier LSTM#29Bit per Character (BPC): 1.146Number of params: 48M
language-modelling-on-enwiki8LSTM#30Bit per Character (BPC): 1.195Number of params: 48M
language-modelling-on-hutter-prizeMogrifier LSTM + dynamic eval#3Bit per Character (BPC): 0.988Number of params: 96M
language-modelling-on-hutter-prizeMogrifier LSTM#12Bit per Character (BPC): 1.122Number of params: 96M
language-modelling-on-penn-treebank-characterMogrifier LSTM + dynamic eval#1Bit per Character (BPC): 1.083Number of params: 24M
language-modelling-on-penn-treebank-characterMogrifier LSTM#2Bit per Character (BPC): 1.120Number of params: 24M
language-modelling-on-penn-treebank-wordMogrifier LSTM + dynamic eval#4Test perplexity: 44.9Validation perplexity: 44.8Params: 24M
language-modelling-on-wikitext-2Mogrifier LSTM + dynamic eval#11Test perplexity: 38.6Validation perplexity: 40.2Number of params: 35M
language-modelling-on-wikitext-2Mogrifier LSTM#21Test perplexity: 55.1Validation perplexity: 57.3Number of params: 35M