Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation

Benchmark Model Rank Results
machine-translation-on-wmt2014-english-frenchTransformer Big + MoS#18BLEU score: 42.1
machine-translation-on-wmt2014-english-germanTransformer Big + MoS#20BLEU score: 29.6