Understanding and Improving Layer Normalization

Benchmark Model Rank Results
machine-translation-on-iwslt2015-english-vietnameseTransformer+LayerNorm-simple#5BLEU: 31.4