MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities

Benchmark Model Rank Results
monocular-depth-estimation-on-diode-relative-depth-alignedModus#2AbsRel: 0.285delta1: 0.718
monocular-depth-estimation-on-scannet-relative-depth-alignedModus#11AbsRel: 0.067delta1: 0.957
object-hallucination-evaluation-on-popeModus#17F1: 87.27
monocular-depth-estimation-on-nyu-depth-v2Modus#20absolute relative error: 0.065Delta < 1.25: 0.958
visual-question-answering-on-docvqa-testModus#42ANLS: 0.9011
chart-question-answering-on-chartqaModus#571:1 Accuracy: 82.45
multimodal-reasoning-on-mmmuMODUS#96Accuracy: 51.1
text-to-image-generation-on-genevalMODUS (original prompts, no self-verification)#96Overall: 0.81