Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling

Benchmark Model Rank Results
object-hallucination-evaluation-on-popeJanus-Pro-7B#14F1: 87.4
visual-question-answering-vqa-on-seed-seedbenchJanus-Pro-7B#20Accuracy: 72.1
visual-question-answering-vqa-on-mmbench-enJanus-Pro-7B#25Accuracy: 79.2
text-to-image-generation-on-wiseJanus-Pro-7B#30Overall: 0.35Cultural: 0.30Time: 0.37Space: 0.49Biology: 0.36…
image-generation-on-wiseJanus-pro#57Overall: 0.35Cultural: 0.30Time: 0.37Space: 0.49Biology: 0.36…
image-generation-on-wiseJanus#58Overall: 0.23Cultural: 0.16Time: 0.26Space: 0.35Biology: 0.28…
visual-question-answering-on-mm-vetJanus-Pro-7B#67GPT-4 score: 50.0
visual-question-answering-on-mm-vetJanus-Pro-1B#103GPT-4 score: 39.8
text-to-image-generation-on-genevalJanus-Pro-7B#103Overall: 0.80
text-to-image-generation-on-genevalJanus-Pro-1B#131Overall: 0.73
multimodal-reasoning-on-mmmuJanus-Pro-7B#126Accuracy: 41.0