LFM2.5-VL-450M: Structured Visual Intelligence, Edge to Cloud

Benchmark Model Rank Results
agents-on-bfclv4LFM2.5-VL-450M–Accuracy: 21.08
instruction-following-on-multi-ifLFM2.5-VL-450M–Accuracy: 34.63
multi-task-language-understanding-on-mmlu-proLFM2.5-VL-450M–Accuracy: 19.32
multimodal-reasoning-on-mmmuLFM2.5-VL-450M–Accuracy: 32.67
object-counting-on-countbenchLFM2.5-VL-450M–Accuracy: 73.31
object-hallucination-evaluation-on-popeLFM2.5-VL-450M–F1: 86.93
optical-character-recognition-ocr-on-ocrbenchLFM2.5-VL-450M–Score: 684
vision-language-understanding-on-mmstarLFM2.5-VL-450M–Accuracy: 43.00
visual-question-answering-on-mm-vetLFM2.5-VL-450M–GPT-4 score: 41.10
visual-question-answering-vqa-on-blinkLFM2.5-VL-450M–Accuracy: 43.92
visual-question-answering-vqa-on-realworldqaLFM2.5-VL-450M–Accuracy: 58.43