MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Benchmark Model Rank Results
visual-question-answering-on-mm-vetMM1.5-1B–GPT-4 score: 37.4
visual-question-answering-on-mm-vetMM1.5-1B-MoE–GPT-4 score: 39.8
visual-question-answering-on-mm-vetMM1.5-30B–GPT-4 score: 52.0
visual-question-answering-on-mm-vetMM1.5-3B–GPT-4 score: 41.0
visual-question-answering-on-mm-vetMM1.5-3B-MoE–GPT-4 score: 43.7
visual-question-answering-on-mm-vetMM1.5-7B–GPT-4 score: 42.2