MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Benchmark Model Rank Results
visual-question-answering-on-mm-vetMM1.5-1BGPT-4 score: 37.4
visual-question-answering-on-mm-vetMM1.5-1B-MoEGPT-4 score: 39.8
visual-question-answering-on-mm-vetMM1.5-30BGPT-4 score: 52.0
visual-question-answering-on-mm-vetMM1.5-3BGPT-4 score: 41.0
visual-question-answering-on-mm-vetMM1.5-3B-MoEGPT-4 score: 43.7
visual-question-answering-on-mm-vetMM1.5-7BGPT-4 score: 42.2