Integrating Pre-trained Language Model into Neural Machine Translation

Open paper

Benchmark	Model	Rank	Results
machine-translation-on-iwslt2014-english	PiNMT	–	BLEU score: 32.2
machine-translation-on-iwslt2014-german	PiNMT	–	BLEU score: 40.43