Fast-Slow Recurrent Neural Networks

Benchmark Model Rank Results
language-modelling-on-enwiki8Large FS-LSTM-4#33Bit per Character (BPC): 1.25Number of params: 47M
language-modelling-on-hutter-prizeLarge FS-LSTM-4#15Bit per Character (BPC): 1.245Number of params: 47M
language-modelling-on-hutter-prizeFS-LSTM-4#17Bit per Character (BPC): 1.277Number of params: 27M
language-modelling-on-penn-treebank-characterFS-LSTM-4#9Bit per Character (BPC): 1.190Number of params: 27M
language-modelling-on-penn-treebank-characterFS-LSTM-2#11Bit per Character (BPC): 1.193Number of params: 27M