Transformers without Tears: Improving the Normalization of Self-Attention
Open paper
Benchmark
Model
Rank
Results
machine-translation-on-iwslt2015-english-vietnamese
Transformer+BPE+FixNorm+ScaleNorm
#4
BLEU: 32.8
Rank counts only results with a code link.