Recurrent Highway Networks

Benchmark Model Rank Results
language-modelling-on-enwiki8Recurrent Highway Networks#34Bit per Character (BPC): 1.27Number of params: 46M
language-modelling-on-hutter-prizeLarge RHN#16Bit per Character (BPC): 1.27Number of params: 46M
language-modelling-on-hutter-prizeRHN - depth 5 [zilly2016recurrent]#18Bit per Character (BPC): 1.31
language-modelling-on-penn-treebank-wordRecurrent highway networks#32Test perplexity: 65.4Validation perplexity: 67.9Params: 23M
language-modelling-on-text8Large RHN#16Bit per Character (BPC): 1.27Number of params: 46M