Lessons on Parameter Sharing across Layers in Transformers
Open paper
Benchmark
Model
Rank
Results
machine-translation-on-wmt2014-english-german
Transformer Cycle (Rev)
#1
BLEU score: 35.14
SacreBLEU: 33.54
Rank counts only results with a code link.