MMEB Leaderboard

Benchmark Model Rank Results
representation-learning-on-mmeb-v3WeMM-Embedding-9B#1MMEB-v3 Score: 59.33
representation-learning-on-mmeb-v3WeMM-Embedding-4B#3MMEB-v3 Score: 57.97
representation-learning-on-mmeb-v3WeMM-Embedding-2B#4MMEB-v3 Score: 55.77
representation-learning-on-mmeb-v3UEmbed-9B (hybrid)#5MMEB-v3 Score: 52.26
representation-learning-on-mmeb-v3UEmbed-9B (dense)#6MMEB-v3 Score: 52.22
representation-learning-on-mmeb-v3UEmbed-9B (sparse)#7MMEB-v3 Score: 51.77
representation-learning-on-mmeb-v3UEmbed-4B (dense)#8MMEB-v3 Score: 51.01
representation-learning-on-mmeb-v3UEmbed-4B (sparse)#9MMEB-v3 Score: 50.85
representation-learning-on-mmeb-v3UEmbed-2B (sparse)#10MMEB-v3 Score: 47.76
representation-learning-on-mmeb-v3LCO-Embedding-Omni-7B#11MMEB-v3 Score: 43.14
representation-learning-on-mmeb-v3Qwen3-VL-Embedding-8B#12MMEB-v3 Score: 31.95
representation-learning-on-mmeb-v3Qwen3-VL-Embedding-2B#13MMEB-v3 Score: 30.07
representation-learning-on-mmeb-v3UME-R1-7B#14MMEB-v3 Score: 26.3
representation-learning-on-mmeb-v3interestFM-UIR-CAFe-7B#15MMEB-v3 Score: 24.7
representation-learning-on-mmeb-v3UME-R1-2B#16MMEB-v3 Score: 24.5
representation-learning-on-mmeb-v3EmbeddingGemma-2#17MMEB-v3 Score: 24.22
representation-learning-on-mmeb-v3interestFM-UIR-CAFe-0.5B#18MMEB-v3 Score: 20.25
representation-learning-on-mmeb-v3DME-Large–MMEB-v3 Score: 32.94
representation-learning-on-mmeb-v3DME-Medium–MMEB-v3 Score: 32.18
representation-learning-on-mmeb-v3DME-Small–MMEB-v3 Score: 30.69
representation-learning-on-mmeb-v3RGE(Qwen2.5VL-3B)–MMEB-v3 Score: 13.29
representation-learning-on-mmeb-v3RGE(Qwen2.5VL-7B)–MMEB-v3 Score: 13.76
representation-learning-on-mmeb-v3RGE(Qwen2VL-2B)–MMEB-v3 Score: 13.16
representation-learning-on-mmeb-v3RGE(Qwen2VL-7B)–MMEB-v3 Score: 14.08
representation-learning-on-mmeb-v3e5-omni-3B–MMEB-v3 Score: 44.63
representation-learning-on-mmeb-v3e5-omni-7B–MMEB-v3 Score: 47.14
representation-learning-on-mmeb-v3gme-Qwen2-VL-2B-Instruct–MMEB-v3 Score: 22.02
representation-learning-on-mmeb-v3gme-Qwen2-VL-7B-Instruct–MMEB-v3 Score: 23.53
representation-learning-on-mmeb-v2WeMM-Embedding-9B#2MMEB-v2 Score: 80.58
representation-learning-on-mmeb-v2WeMM-Embedding-4B#3MMEB-v2 Score: 79.19
representation-learning-on-mmeb-v2WeMM-Embedding-2B#4MMEB-v2 Score: 77.94
representation-learning-on-mmeb-v2Qwen3-VL-Embedding-8B#5MMEB-v2 Score: 77.82
representation-learning-on-mmeb-v2Qwen3-VL-Embedding-2B#6MMEB-v2 Score: 73.25
representation-learning-on-mmeb-v2UEmbed-9B (hybrid)#7MMEB-v2 Score: 71.83
representation-learning-on-mmeb-v2UEmbed-9B (dense)#8MMEB-v2 Score: 71.77
representation-learning-on-mmeb-v2UEmbed-9B (sparse)#9MMEB-v2 Score: 71.05
representation-learning-on-mmeb-v2UEmbed-4B (dense)#10MMEB-v2 Score: 70.36
representation-learning-on-mmeb-v2UEmbed-4B (sparse)#11MMEB-v2 Score: 69.69
representation-learning-on-mmeb-v2UEmbed-2B (dense)#12MMEB-v2 Score: 66.49
representation-learning-on-mmeb-v2UEmbed-2B (sparse)#13MMEB-v2 Score: 65.53
representation-learning-on-mmeb-v2UME-R1-7B#14MMEB-v2 Score: 64.07
representation-learning-on-mmeb-v2interestFM-UIR-CAFe-7B#15MMEB-v2 Score: 60.17
representation-learning-on-mmeb-v2LCO-Embedding-Omni-7B#16MMEB-v2 Score: 59.96
representation-learning-on-mmeb-v2UME-R1-2B#17MMEB-v2 Score: 59.69
representation-learning-on-mmeb-v2EmbeddingGemma-2#18MMEB-v2 Score: 59.01
representation-learning-on-mmeb-v2interestFM-UIR-CAFe-0.5B#19MMEB-v2 Score: 49.33
representation-learning-on-mmeb-v2DME-Large–MMEB-v2 Score: 80.24
representation-learning-on-mmeb-v2DME-Medium–MMEB-v2 Score: 78.38
representation-learning-on-mmeb-v2DME-Small–MMEB-v2 Score: 74.75
representation-learning-on-mmeb-v2RGE(Qwen2.5VL-3B)–MMEB-v2 Score: 32.36
representation-learning-on-mmeb-v2RGE(Qwen2.5VL-7B)–MMEB-v2 Score: 33.52
representation-learning-on-mmeb-v2RGE(Qwen2VL-2B)–MMEB-v2 Score: 32.06
representation-learning-on-mmeb-v2RGE(Qwen2VL-7B)–MMEB-v2 Score: 34.3
representation-learning-on-mmeb-v2e5-omni-3B–MMEB-v2 Score: 63.59
representation-learning-on-mmeb-v2e5-omni-7B–MMEB-v2 Score: 67.84
representation-learning-on-mmeb-v2gme-Qwen2-VL-2B-Instruct–MMEB-v2 Score: 53.65
representation-learning-on-mmeb-v2gme-Qwen2-VL-7B-Instruct–MMEB-v2 Score: 57.32