Recurrent Highway Networks with Grouped Auxiliary Memory

Benchmark Model Rank Results
language-modelling-on-penn-treebank-characterGAM-RHN-5#3Bit per Character (BPC): 1.147Number of params: 16.0M
language-modelling-on-text8GAM-RHN-10#11Bit per Character (BPC): 1.157Number of params: 44.7M
sequential-image-classification-on-sequentialGAM-RHN-1#17Permuted Accuracy: 96.8%