Emerging Properties in Unified Multimodal Pretraining

Benchmark Model Rank Results
image-editing-on-kris-benchBAGEL (7B active / 14B total MoT) with Self-CoT#4KRIS-Bench Overall: 60.18
visual-question-answering-vqa-on-mmeBAGEL (7B MoT)#6Score: 2388
image-editing-on-risebenchBAGEL (w/ Self-CoT)#8RISEBench Overall Accuracy: 11.9
text-to-image-generation-on-wiseBAGEL#16Overall: 0.52Cultural: 0.44Time: 0.55Space: 0.68Biology: 0.44…
visual-question-answering-vqa-on-mmbench-enBAGEL (7B MoT)#16Accuracy: 85.0
image-generation-on-wiseBagel (w/ cot)#17Overall: 0.70Cultural: 0.76Time: 0.69Space: 0.75Biology: 0.65…
image-generation-on-wiseBagel#41Overall: 0.52Cultural: 0.44Time: 0.55Space: 0.68Biology: 0.44…
image-editing-on-imgedit-dataBAGEL#26Overall: 3.20Add: 3.56Adjust: 3.31Extract: 1.70Replace: 3.30…
image-editing-on-gedit-bench-enBAGEL#30Overall: 6.52Perceptual Quality: 6.83Semantic Consistency: 7.36
multimodal-reasoning-on-mathvistaBAGEL (7B MoT)#57Accuracy: 73.1
multimodal-reasoning-on-mmmuBAGEL (7B MoT)#74Accuracy: 55.3
text-to-image-generation-on-genevalBAGEL (7B MoT)#90Overall: 0.82