LFM2.5-1.2B-Thinking: On-Device Reasoning Under 1GB

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kLFM2.5-1.2B-Thinking–Accuracy: 85.60
instruction-following-on-ifbenchLFM2.5-1.2B-Thinking–Accuracy: 44.85
instruction-following-on-multi-ifLFM2.5-1.2B-Thinking–Accuracy: 69.33
mathematical-reasoning-on-aime-2025LFM2.5-1.2B-Thinking–Accuracy: 31.73
multi-task-language-understanding-on-mmlu-proLFM2.5-1.2B-Thinking–Accuracy: 49.65
multiple-choice-question-answering-mcqa-on-gpqa-diamondLFM2.5-1.2B-Thinking–Accuracy: 37.86