Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languages

Open paper
Benchmark Model Rank Results
speech-recognition-on-amifacebook/omniASR-LLM-7B-v2#51Word Error Rate (WER): 19.45
speech-recognition-on-amifacebook/omniASR-CTC-7B-v2#55Word Error Rate (WER): 22.1
speech-recognition-on-ami-cleanedfacebook/omniASR-LLM-7B-v2#41Word Error Rate (WER): 13.86
speech-recognition-on-ami-cleanedfacebook/omniASR-CTC-7B-v2#55Word Error Rate (WER): 17.44
speech-recognition-on-earnings-22facebook/omniASR-LLM-7B-v2#41Word Error Rate (WER): 13.15
speech-recognition-on-earnings-22facebook/omniASR-CTC-7B-v2#50Word Error Rate (WER): 16.02
speech-recognition-on-gigaspeech-cleanedfacebook/omniASR-LLM-7B-v2#42Word Error Rate (WER): 9.21
speech-recognition-on-gigaspeech-cleanedfacebook/omniASR-CTC-7B-v2#56Word Error Rate (WER): 12.95
speech-recognition-on-gigaspeech-testfacebook/omniASR-LLM-7B-v2#43Word Error Rate (WER): 9.5
speech-recognition-on-gigaspeech-testfacebook/omniASR-CTC-7B-v2#60Word Error Rate (WER): 13.36
speech-recognition-on-librispeech-test-cleanfacebook/omniASR-LLM-7B-v2#22Word Error Rate (WER): 1.35
speech-recognition-on-librispeech-test-cleanfacebook/omniASR-CTC-7B-v2#80Word Error Rate (WER): 2.12
speech-recognition-on-librispeech-test-otherfacebook/omniASR-LLM-7B-v2#32Word Error Rate (WER): 3.25
speech-recognition-on-librispeech-test-otherfacebook/omniASR-CTC-7B-v2#85Word Error Rate (WER): 5.05
speech-recognition-on-spgispeechfacebook/omniASR-LLM-7B-v2#36Word Error Rate (WER): 3.22
speech-recognition-on-spgispeechfacebook/omniASR-CTC-7B-v2#53Word Error Rate (WER): 5.16
speech-recognition-on-voxpopulifacebook/omniASR-LLM-7B-v2#24Word Error Rate (WER): 6.39
speech-recognition-on-voxpopulifacebook/omniASR-CTC-7B-v2#43Word Error Rate (WER): 7.82
speech-recognition-on-voxpopuli-cleanedfacebook/omniASR-LLM-7B-v2#33Word Error Rate (WER): 4.03
speech-recognition-on-voxpopuli-cleanedfacebook/omniASR-CTC-7B-v2#48Word Error Rate (WER): 4.43

Rank counts only results with a code link.