SeamlessM4T: Massively Multilingual & Multimodal Machine Translation

Benchmark Model Rank Results
machine-translation-on-flores-200SeamlessM4T-Large-V1#3BLEU: 37.5
machine-translation-on-flores95-devtest-eng-xSeamlessM4T Large#1ChrF++: 50.9
machine-translation-on-flores95-devtest-eng-xSeamlessM4T-NLLB-1.3B#2ChrF++: 49.6
machine-translation-on-flores95-devtest-eng-xSeamlessM4T Medium#3ChrF++: 48.4
machine-translation-on-flores95-devtest-x-engSeamlessM4T Large#1ChrF++: 60.8
machine-translation-on-flores95-devtest-x-engSeamlessM4T-NLLB-1.3B#2ChrF++: 60.7
machine-translation-on-flores95-devtest-x-engSeamlessM4T Medium#3ChrF++: 55.4
speech-to-speech-translation-on-fleurs-x-engSeamlessM4T LargeV2#3ASR-BLEU: 29.4
speech-to-speech-translation-on-fleurs-x-engSeamlessM4T Large#4ASR-BLEU: 25.8
speech-to-speech-translation-on-fleurs-x-engSeamlessM4T Medium#7ASR-BLEU: 20.4