Lite Transformer with Long-Short Range Attention

Open paper
Benchmark Model Rank Results
machine-translation-on-wmt2014-english-frenchLite Transformer#36BLEU score: 39.6
machine-translation-on-wmt2014-english-germanLite Transformer#49BLEU score: 26.5Number of Params: 17.3M

Rank counts only results with a code link.