FRAGE: Frequency-Agnostic Word Representation

Benchmark Model Rank Results
language-modelling-on-penn-treebank-wordFRAGE + AWD-LSTM-MoS + dynamic eval#7Test perplexity: 46.54Validation perplexity: 47.38Params: 22M
language-modelling-on-wikitext-2FRAGE + AWD-LSTM-MoS + dynamic eval#13Test perplexity: 39.14Validation perplexity: 40.85
machine-translation-on-iwslt2015-germanTransformer with FRAGE#3BLEU score: 33.97
machine-translation-on-wmt2014-english-germanTransformer Big with FRAGE#28BLEU score: 29.11