Emu3: Next-Token Prediction is All You Need

Benchmark Model Rank Results
text-to-image-generation-on-wiseEmu3#27Overall: 0.39Cultural: 0.34Time: 0.45Space: 0.48Biology: 0.41…
visual-question-answering-vqa-on-seed-seedbenchEmu3#27Accuracy: 68.2
image-generation-on-wiseEmu3-gen#54Overall: 0.39Cultural: 0.34Time: 0.45Space: 0.48Biology: 0.41…
optical-character-recognition-ocr-on-ocrbenchEmu3#64Score: 687
visual-question-answering-on-docvqa-testEmu3#76ANLS: 0.763
visual-question-answering-vqa-on-realworldqaEmu3#88Accuracy: 57.4
chart-question-answering-on-chartqaEmu3 (extra data)#1001:1 Accuracy: 68.6
visual-question-answering-on-mm-vetEmu3#120GPT-4 score: 37.2
multimodal-reasoning-on-mmmuEmu3#135Accuracy: 31.6
text-to-image-generation-on-genevalEmu3#147Overall: 0.66