MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens
Open paper
Benchmark
Model
Rank
Results
audio-visual-speech-recognition-on-lrs3-ted
MMS-LLaMA
#1
Word Error Rate (WER): 0.74
Rank counts only results with a code link.