One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling

Benchmark Model Rank Results
language-modelling-on-one-billion-wordRNN-1024 + 9 Gram#23PPL: 51.3Number of params: 20B