Transformer-based ASR Incorporating Time-reduction Layer and Fine-tuning with Self-Knowledge Distillation

Open paper

Benchmark	Model	Rank	Results
speech-recognition-on-librispeech-test-clean	Transformer+Time reduction+Self Knowledge distillation	–	Word Error Rate (WER): 1.9