PowerNorm: Rethinking Batch Normalization in Transformers
Open paper
Benchmark
Model
Rank
Results
machine-translation-on-wmt2014-english-german
PowerNorm (Transformer)
#12
BLEU score: 30.1
Rank counts only results with a code link.