Sequence-Level Knowledge Distillation

Benchmark Model Rank Results
machine-translation-on-wmt2014-english-germanSeq-KD + Seq-Inter + Word-KD#75BLEU score: 18.5