| instruction-following-on-multi-if | LFM2-8B-A1B | #9 | Accuracy: 58.19 |
| visual-question-answering-vqa-on-seed-seedbench | LFM2-VL-3B | #10 | Accuracy: 76.55 |
| visual-question-answering-vqa-on-mme | LFM2-VL-3B | #12 | Score: 2051 |
| multi-task-language-understanding-on-mmmlu | LFM2-8B-A1B (0-shot) | #14 | Accuracy: 55.26 |
| multi-task-language-understanding-on-mmlu | LFM2-8B-A1B (5-shot) | #40 | Average (%): 64.84 |
| visual-question-answering-vqa-on-blink | LFM2-VL-3B | #44 | Accuracy: 51.03 |
| visual-question-answering-vqa-on-realworldqa | LFM2-VL-3B | #44 | Accuracy: 71.37 |
| instruction-following-on-ifbench | LFM2-8B-A1B | #47 | Accuracy: 25.85 |
| optical-character-recognition-ocr-on-ocrbench | LFM2-VL-3B | #47 | Score: 822 |
| visual-question-answering-on-mm-vet | LFM2-VL-1.6B | #76 | GPT-4 score: 48.07 |
| vision-language-understanding-on-mmstar | LFM2-VL-3B | #85 | Accuracy: 57.73 |
| multimodal-reasoning-on-mathvista | LFM2-VL-3B | #91 | Accuracy: 62.20 |
| multimodal-reasoning-on-mmmu | LFM2-VL-3B | #110 | Accuracy: 45.33 |
| arithmetic-reasoning-on-gsm8k | LFM2-8B-A1B (5-shot) | #121 | Accuracy: 84.38 |
| multi-task-language-understanding-on-mmlu-pro | LFM2-8B-A1B (5-shot CoT) | #124 | Accuracy: 37.42 |
| multiple-choice-question-answering-mcqa-on-gpqa-diamond | LFM2-8B-A1B (0-shot) | #132 | Accuracy: 29.29 |