MTEB: Massive Text Embedding Benchmark

Open paper
Benchmark Model Rank Results
semantic-textual-similarity-on-mtebST5-XXL#2Spearman Correlation: 82.63
semantic-textual-similarity-on-mtebST5-Large#3Spearman Correlation: 81.83
semantic-textual-similarity-on-mtebST5-XL#4Spearman Correlation: 81.66
semantic-textual-similarity-on-mtebST5-Base#5Spearman Correlation: 81.14
semantic-textual-similarity-on-mtebMPNet-multilingual#6Spearman Correlation: 80.73
semantic-textual-similarity-on-mtebSGPT-5.8B-nli#7Spearman Correlation: 80.53
semantic-textual-similarity-on-mtebMPNet#8Spearman Correlation: 80.28
semantic-textual-similarity-on-mtebMiniLM-L12#9Spearman Correlation: 79.8
semantic-textual-similarity-on-mtebSimCSE-BERT-sup#10Spearman Correlation: 79.12
semantic-textual-similarity-on-mtebMiniLM-L6#11Spearman Correlation: 78.92
semantic-textual-similarity-on-mtebAda Similarity#12Spearman Correlation: 78.6
semantic-textual-similarity-on-mtebGTR-XXL#13Spearman Correlation: 78.38
semantic-textual-similarity-on-mtebGTR-Large#14Spearman Correlation: 78.19
semantic-textual-similarity-on-mtebSGPT-5.8B-msmarco#15Spearman Correlation: 78.1
semantic-textual-similarity-on-mtebGTR-XL#16Spearman Correlation: 77.8
semantic-textual-similarity-on-mtebSGPT-BLOOM-7.1B-msmarco#17Spearman Correlation: 77.74
semantic-textual-similarity-on-mtebGTR-Base#18Spearman Correlation: 77.07
semantic-textual-similarity-on-mtebSGPT-2.7B-msmarco#19Spearman Correlation: 76.83
semantic-textual-similarity-on-mtebcoCondenser-msmarco#20Spearman Correlation: 76.47
semantic-textual-similarity-on-mtebSGPT-1.3B-msmarco#21Spearman Correlation: 75.74
semantic-textual-similarity-on-mtebSGPT-125M-nli#22Spearman Correlation: 74.71
semantic-textual-similarity-on-mtebSimCSE-BERT-unsup#23Spearman Correlation: 74.33
semantic-textual-similarity-on-mtebSGPT-125M-msmarco#24Spearman Correlation: 73.41
semantic-textual-similarity-on-mtebLaBSE#25Spearman Correlation: 70.8
semantic-textual-similarity-on-mtebKomninos#26Spearman Correlation: 62.47
semantic-textual-similarity-on-mtebGlove#27Spearman Correlation: 61.85
semantic-textual-similarity-on-mtebSPECTER#28Spearman Correlation: 61.02
semantic-textual-similarity-on-mtebLASER2#29Spearman Correlation: 55.32
semantic-textual-similarity-on-mtebBERT#30Spearman Correlation: 54.36
text-classification-on-mtebST5-XXL#1Accuracy: 73.42
text-classification-on-mtebST5-XL#2Accuracy: 72.84
text-classification-on-mtebST5-Large#3Accuracy: 72.31
text-classification-on-mtebAda Similarity#4Accuracy: 70.44
text-classification-on-mtebSGPT-5.8B-nli#5Accuracy: 70.14
text-classification-on-mtebST5-Base#6Accuracy: 69.81
text-classification-on-mtebSGPT-5.8B-msmarco#7Accuracy: 68.13
text-classification-on-mtebMPNet-multilingual#8Accuracy: 67.91
text-classification-on-mtebGTR-XXL#9Accuracy: 67.41
text-classification-on-mtebSimCSE-BERT-sup#10Accuracy: 67.32
text-classification-on-mtebGTR-Large#11Accuracy: 67.14
text-classification-on-mtebSGPT-2.7B-msmarco#12Accuracy: 67.13
text-classification-on-mtebGTR-XL#13Accuracy: 67.11
text-classification-on-mtebContriever#14Accuracy: 66.68
text-classification-on-mtebSGPT-1.3B-msmarco#15Accuracy: 66.52
text-classification-on-mtebSGPT-BLOOM-7.1B-msmarco#16Accuracy: 66.19
text-classification-on-mtebGTR-Base#17Accuracy: 65.25
text-classification-on-mtebMPNet#18Accuracy: 65.07
text-classification-on-mtebcoCondenser-msmarco#19Accuracy: 64.71
text-classification-on-mtebMiniLM-L12-multilingual#20Accuracy: 64.3
text-classification-on-mtebMiniLM-L12#21Accuracy: 63.21
text-classification-on-mtebMiniLM-L6#22Accuracy: 63.06
text-classification-on-mtebLaBSE#23Accuracy: 62.71
text-classification-on-mtebSimCSE-BERT-unsup#24Accuracy: 62.5
text-classification-on-mtebBERT#25Accuracy: 61.66
text-classification-on-mtebSGPT-125M-nli#26Accuracy: 61.46
text-classification-on-mtebSGPT-125M-msmarco#27Accuracy: 60.72
text-classification-on-mtebKomninos#28Accuracy: 57.65
text-classification-on-mtebGlove#29Accuracy: 57.29
text-classification-on-mtebLASER2#30Accuracy: 53.65
text-classification-on-mtebSPECTER#31Accuracy: 52.37
text-clustering-on-mtebST5-XXL#1V-Measure: 43.71
text-clustering-on-mtebMPNet#2V-Measure: 43.69
text-clustering-on-mtebGTR-XXL#3V-Measure: 42.42
text-clustering-on-mtebMiniLM-L6#4V-Measure: 42.35
text-clustering-on-mtebST5-XL#5V-Measure: 42.34
text-clustering-on-mtebMiniLM-L12#6V-Measure: 41.81
text-clustering-on-mtebST5-Large#7V-Measure: 41.65
text-clustering-on-mtebGTR-Large#8V-Measure: 41.6
text-clustering-on-mtebGTR-XL#9V-Measure: 41.51
text-clustering-on-mtebContriever#10V-Measure: 41.1
text-clustering-on-mtebSGPT-5.8B-msmarco#11V-Measure: 40.35
text-clustering-on-mtebST5-Base#12V-Measure: 40.21
text-clustering-on-mtebSGPT-1.3B-msmarco#13V-Measure: 39.92
text-clustering-on-mtebSGPT-2.7B-msmarco#14V-Measure: 39.83
text-clustering-on-mtebSGPT-BLOOM-7.1B-msmarco#15V-Measure: 38.93
text-clustering-on-mtebGTR-Base#16V-Measure: 38.63
text-clustering-on-mtebMPNet-multilingual#17V-Measure: 38.4
text-clustering-on-mtebcoCondenser-msmarco#18V-Measure: 37.64
text-clustering-on-mtebAda Similarity#19V-Measure: 37.52
text-clustering-on-mtebMiniLM-L12-multilingual#20V-Measure: 37.14
text-clustering-on-mtebSGPT-5.8B-nli#21V-Measure: 36.98
text-clustering-on-mtebSGPT-125M-msmarco#22V-Measure: 35.79
text-clustering-on-mtebSPECTER#23V-Measure: 34.06
text-clustering-on-mtebSimCSE-BERT-sup#24V-Measure: 33.43
text-clustering-on-mtebSGPT-125M-nli#25V-Measure: 30.95
text-clustering-on-mtebBERT#26V-Measure: 30.12
text-clustering-on-mtebLaBSE#27V-Measure: 29.55
text-clustering-on-mtebSimCSE-BERT-unsup#28V-Measure: 29.04
text-clustering-on-mtebGlove#29V-Measure: 27.73
text-clustering-on-mtebKomninos#30V-Measure: 26.57
text-clustering-on-mtebLASER2#31V-Measure: 15.28
text-retrieval-on-mtebSGPT-5.8B-msmarco#1nDCG@10: 50.25
text-retrieval-on-mtebGTR-XXL#2nDCG@10: 48.48
text-retrieval-on-mtebSGPT-BLOOM-7.1B-msmarco#3nDCG@10: 48.21
text-retrieval-on-mtebGTR-XL#4nDCG@10: 47.96
text-retrieval-on-mtebGTR-Large#5nDCG@10: 47.42
text-retrieval-on-mtebSGPT-2.7B-msmarco#6nDCG@10: 46.54
text-retrieval-on-mtebGTR-Base#7nDCG@10: 44.67
text-retrieval-on-mtebSGPT-1.3B-msmarco#8nDCG@10: 44.49
text-retrieval-on-mtebMPNet#9nDCG@10: 43.81
text-retrieval-on-mtebMiniLM-L12#10nDCG@10: 42.69
text-retrieval-on-mtebST5-XXL#11nDCG@10: 42.24
text-retrieval-on-mtebMiniLM-L6#12nDCG@10: 41.95
text-retrieval-on-mtebContriever#13nDCG@10: 41.88
text-retrieval-on-mtebST5-XL#14nDCG@10: 38.47
text-retrieval-on-mtebSGPT-125M-msmarco#15nDCG@10: 37.04
text-retrieval-on-mtebST5-Large#16nDCG@10: 36.71
text-retrieval-on-mtebMPNet-multilingual#17nDCG@10: 35.34
text-retrieval-on-mtebST5-Base#18nDCG@10: 33.63
text-retrieval-on-mtebcoCondenser-msmarco#19nDCG@10: 32.96
text-retrieval-on-mtebMiniLM-L12-multilingual#20nDCG@10: 32.45
text-retrieval-on-mtebSGPT-5.8B-nli#21nDCG@10: 32.34
text-retrieval-on-mtebSimCSE-BERT-sup#22nDCG@10: 21.82
text-retrieval-on-mtebGlove#23nDCG@10: 21.62
text-retrieval-on-mtebKomninos#24nDCG@10: 21.22
text-retrieval-on-mtebSGPT-125M-nli#25nDCG@10: 20.9
text-retrieval-on-mtebSimCSE-BERT-unsup#26nDCG@10: 20.29
text-retrieval-on-mtebLaBSE#27nDCG@10: 18.99
text-retrieval-on-mtebSPECTER#28nDCG@10: 15.88
text-retrieval-on-mtebBERT#29nDCG@10: 10.59
text-retrieval-on-mtebLASER2#30nDCG@10: 7.93
text-summarization-on-mtebMPNet-multilingual#1Spearman Correlation: 31.57
text-summarization-on-mtebST5-Base#2Spearman Correlation: 31.39
text-summarization-on-mtebSimCSE-BERT-unsup#3Spearman Correlation: 31.15
text-summarization-on-mtebMiniLM-L6#4Spearman Correlation: 30.81
text-summarization-on-mtebMiniLM-L12-multilingual#5Spearman Correlation: 30.67
text-summarization-on-mtebGTR-XXL#6Spearman Correlation: 30.64
text-summarization-on-mtebKomninos#7Spearman Correlation: 30.49
text-summarization-on-mtebContriever#8Spearman Correlation: 30.36
text-summarization-on-mtebSGPT-125M-nli#9Spearman Correlation: 30.26
text-summarization-on-mtebGTR-XL#10Spearman Correlation: 30.21
text-summarization-on-mtebST5-XXL#11Spearman Correlation: 30.08
text-summarization-on-mtebST5-XL#12Spearman Correlation: 29.91
text-summarization-on-mtebBERT#13Spearman Correlation: 29.82
text-summarization-on-mtebGTR-Base#14Spearman Correlation: 29.67
text-summarization-on-mtebST5-Large#15Spearman Correlation: 29.64
text-summarization-on-mtebcoCondenser-msmarco#16Spearman Correlation: 29.5
text-summarization-on-mtebGlove#17Spearman Correlation: 28.87
text-summarization-on-mtebMiniLM-L12#18Spearman Correlation: 27.9
text-summarization-on-mtebSPECTER#19Spearman Correlation: 27.66
text-summarization-on-mtebMPNet#20Spearman Correlation: 27.49
text-summarization-on-mtebAda Similarity#21Spearman Correlation: 26.94
text-summarization-on-mtebLASER2#22Spearman Correlation: 26.8
text-summarization-on-mtebSGPT-1.3B-msmarco#23Spearman Correlation: 25.44
text-summarization-on-mtebSGPT-BLOOM-7.1B-msmarco#24Spearman Correlation: 24.99
text-summarization-on-mtebSGPT-5.8B-msmarco#25Spearman Correlation: 24.75
text-summarization-on-mtebSimCSE-BERT-sup#26Spearman Correlation: 23.31

Rank counts only results with a code link.