LoMo: Local Modality Substitution for Deeper Vision-Language Fusion

Benchmark Model Rank Results
document-question-answering-on-mmlongbench-docLoMo (LLaVA-OneVision-1.5-8B)#4Accuracy: 18.06
visual-question-answering-vqa-on-simplevqaLoMo (LLaVA-OneVision-1.5-8B)#15Accuracy: 38.62
multimodal-reasoning-on-mmmu-proLoMo (LLaVA-OneVision-1.5-8B)#57Accuracy: 36.36
multimodal-reasoning-on-mmmuLoMo (LLaVA-OneVision-1.5-8B)#94Accuracy: 51.22
multimodal-reasoning-on-mathvistaLoMo (LLaVA-OneVision-1.5-8B)#102Accuracy: 53.9