LFM2.5-8B-A1B: an Even Better on-Device Mixture-of-Experts

Benchmark Model Rank Results
instruction-following-on-multi-ifLFM2.5-8B-A1B#2Accuracy: 79.93
agents-on-bench-telecomLFM2.5-8B-A1B#4Accuracy: 88.07
agents-on-bfclv4LFM2.5-8B-A1B#13Accuracy: 49.73
instruction-following-on-ifbenchLFM2.5-8B-A1B#33Accuracy: 56.47
mathematical-reasoning-on-aime-2026LFM2.5-8B-A1B#45Accuracy: 50.00
mathematical-reasoning-on-math-500LFM2.5-8B-A1B#61Accuracy: 88.76
mathematical-reasoning-on-aime-2025LFM2.5-8B-A1B#92Accuracy: 42.53