Lessons on Parameter Sharing across Layers in Transformers

Benchmark Model Rank Results
machine-translation-on-wmt2014-english-germanTransformer Cycle (Rev)#1BLEU score: 35.14SacreBLEU: 33.54