Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

Open paper
Benchmark Model Rank Results
semantic-textual-similarity-on-sickMirror-RoBERTa-base (unsup.)#16Spearman Correlation: 0.706
semantic-textual-similarity-on-sickMirror-BERT-base (unsup.)#17Spearman Correlation: 0.703
semantic-textual-similarity-on-sts-benchmarkMirror-RoBERTa-base (unsup.)#47Spearman Correlation: 0.787
semantic-textual-similarity-on-sts-benchmarkMirror-BERT-base (unsup.)#52Spearman Correlation: 0.764
semantic-textual-similarity-on-sts12Mirror-BERT-base (unsup.)#17Spearman Correlation: 0.674
semantic-textual-similarity-on-sts12Mirror-RoBERTa-base (unsup.)#19Spearman Correlation: 0.648
semantic-textual-similarity-on-sts13Mirror-RoBERTa-base (unsup.)#16Spearman Correlation: 0.819
semantic-textual-similarity-on-sts13Mirror-BERT-base (unsup.)#19Spearman Correlation: 0.796
semantic-textual-similarity-on-sts14Mirror-RoBERTa-base (unsup.)#17Spearman Correlation: 0.732
semantic-textual-similarity-on-sts14Mirror-BERT-base (unsup.)#18Spearman Correlation: 0.713
semantic-textual-similarity-on-sts15Mirror-BERT-base (unsup.)#16Spearman Correlation: 0.814
semantic-textual-similarity-on-sts15Mirror-RoBERTa-base (unsup.)#18Spearman Correlation: 0.798
semantic-textual-similarity-on-sts16Mirror-RoBERTa-base (unsup.)#15Spearman Correlation: 0.78
semantic-textual-similarity-on-sts16Mirror-BERT-base (unsup.)#19Spearman Correlation: 0.743

Rank counts only results with a code link.