LVRPO: Language-Visual Alignment with GRPO for Multimodal Understanding and Generation

Benchmark Model Rank Results
image-generation-on-wiseLVRPO–Overall: 0.85Cultural: 0.86Time: 0.78Space: 0.93Biology: 0.89…
multimodal-reasoning-on-mathvistaLVRPO (1.5B)–Accuracy: 68.5
multimodal-reasoning-on-mathvistaLVRPO (7B)–Accuracy: 76.2
multimodal-reasoning-on-mmmuLVRPO (1.5B)–Accuracy: 47.5
multimodal-reasoning-on-mmmuLVRPO (7B)–Accuracy: 58.1
text-to-image-generation-on-genevalLVRPO–Overall: 0.91
visual-question-answering-on-mm-vetLVRPO (1.5B)–GPT-4 score: 53.2
visual-question-answering-on-mm-vetLVRPO (7B)–GPT-4 score: 69.5
visual-question-answering-vqa-on-mmbench-enLVRPO (1.5B)–Accuracy: 83.2
visual-question-answering-vqa-on-mmbench-enLVRPO (7B)–Accuracy: 87.2
visual-question-answering-vqa-on-mmeLVRPO (1.5B)–Score: 2298
visual-question-answering-vqa-on-mmeLVRPO (7B)–Score: 2399