Introducing LFM2.5: The Next Generation of On-Device AI

Benchmark Model Rank Results
instruction-following-on-ifbenchLFM2.5-1.2B-Instruct–Accuracy: 47.33
instruction-following-on-multi-ifLFM2.5-1.2B-Instruct–Accuracy: 60.98
mathematical-reasoning-on-aime-2025LFM2.5-1.2B-Instruct–Accuracy: 14.00
multi-task-language-understanding-on-mmlu-proLFM2.5-1.2B-Instruct–Accuracy: 44.35
multimodal-reasoning-on-mmmuLFM2.5-VL-1.6B–Accuracy: 40.56
speech-recognition-on-librispeech-test-cleanLFM2.5-Audio-1.5B–Word Error Rate (WER): 1.95
speech-recognition-on-librispeech-test-otherLFM2.5-Audio-1.5B–Word Error Rate (WER): 4.30
speech-recognition-on-spgispeechLFM2.5-Audio-1.5B–Word Error Rate (WER): 2.76
vision-language-understanding-on-mmstarLFM2.5-VL-1.6B–Accuracy: 50.67
visual-question-answering-vqa-on-blinkLFM2.5-VL-1.6B–Accuracy: 48.82
visual-question-answering-vqa-on-realworldqaLFM2.5-VL-1.6B–Accuracy: 64.84