Improving Neural Language Modeling via Adversarial Training

Benchmark Model Rank Results
language-modelling-on-penn-treebank-wordadversarial + AWD-LSTM-MoS + dynamic eval#5Test perplexity: 46.01Validation perplexity: 46.63Params: 22M
language-modelling-on-wikitext-103AdvSoft (+ 4 layer QRNN + dynamic eval)#63Test perplexity: 28.0Validation perplexity: 27.2
language-modelling-on-wikitext-2adversarial + AWD-LSTM-MoS + dynamic eval#12Test perplexity: 38.65Validation perplexity: 40.27
machine-translation-on-wmt2014-english-germanTransformer Big + adversarial MLE#23BLEU score: 29.52