OmniNet: Omnidirectional Representations from Transformers

Benchmark Model Rank Results
language-modelling-on-one-billion-wordOmniNetT (Large)#2PPL: 21.5Number of params: 100M
language-modelling-on-one-billion-wordOmniNetP (Large)#3PPL: 21.6Number of params: 100M
language-modelling-on-one-billion-wordOmniNetB (Large)#5PPL: 22
machine-translation-on-wmt2014-english-frenchOmniNetP#17BLEU score: 42.6
machine-translation-on-wmt2014-english-germanOmniNetP#17BLEU score: 29.8
machine-translation-on-wmt2017-chineseOmniNetP#3BLEU: 23.0