Alleviating the Inequality of Attention Heads for Neural Machine Translation
Open paper
Benchmark
Model
Rank
Results
machine-translation-on-wmt2016-romanian-english
HeadMask (Impt-18)
–
BLEU score: 32.95
machine-translation-on-wmt2016-romanian-english
HeadMask (Random-18)
–
BLEU score: 32.85
Rank counts only results with a code link.