Self-training and Pre-training are Complementary for Speech Recognition

Benchmark Model Rank Results
speech-recognition-on-librispeech-test-cleanConv + Transformer + wav2vec2.0 + pseudo labeling#32Word Error Rate (WER): 1.5
speech-recognition-on-librispeech-test-cleanwav2vec_wav2letter#96Word Error Rate (WER): 2.7
speech-recognition-on-librispeech-test-otherConv + Transformer + wav2vec2.0 + pseudo labeling#27Word Error Rate (WER): 3.1