Ovis: Structural Embedding Alignment for Multimodal Large Language Model

Benchmark Model Rank Results
visual-question-answering-vqa-on-mmeOvis-Llama3-8B#15Score: 2009
visual-question-answering-vqa-on-mmbench-cnOvis-Qwen1.5-14B#16Accuracy: 76.6
visual-question-answering-vqa-on-mmbench-enOvis-Qwen1.5-14B#26Accuracy: 78.4
visual-question-answering-vqa-on-realworldqaOvis-Qwen1.5-14B#80Accuracy: 62.7
vision-language-understanding-on-mmstarOvis-Llama3-8B#93Accuracy: 49.5
multimodal-reasoning-on-mmmuOvis-Qwen1.5-14B#104Accuracy: 46.7
multimodal-reasoning-on-mathvistaOvis-Qwen1.5-14B#110Accuracy: 43.4