Differences That Matter: Auditing Models for Capability Gap Discovery and Rectification

Benchmark Model Rank Results
multimodal-reasoning-on-mmmuGemma3 + AuditDM–Accuracy: 45.2
vision-language-understanding-on-mmbench-v1-1Gemma3 + AuditDM–Accuracy: 75.0
vision-language-understanding-on-mmstarGemma3 + AuditDM–Accuracy: 52.4
visual-question-answering-vqa-on-mmt-benchGemma3 + AuditDM–Accuracy: 58.9
visual-question-answering-vqa-on-realworldqaGemma3 + AuditDM–Accuracy: 61.4