| semantic-textual-similarity-on-sts-b-glue-dev | DistilBERT | #9 | Pearson/Spearman Correlation: 86.9 |
| paraphrase-identification-on-mrpc-glue-dev | DistilBERT | #10 | F1: 87.5 |
| semantic-textual-similarity-on-mrpc | DistilBERT 66M | #10 | Accuracy: 90.2% |
| semantic-textual-similarity-on-sts-benchmark | DistilBERT 66M | #11 | Pearson Correlation: 0.907 |
| linguistic-acceptability-on-cola-glue-dev | DistilBERT | #12 | Matthews Correlation: 51.3 |
| question-answering-on-multitq | DistillBERT | #12 | Hits@1: 8.3Hits@10: 48.4 |
| natural-language-inference-on-rte-glue-dev | DistilBERT | #13 | Accuracy: 59.9 |
| natural-language-understanding-on-glue-dev | DistilBERT | #13 | GLUE (dev): 77.0 |
| question-answering-on-quora-question-pairs | DistilBERT 66M | #13 | Accuracy: 89.2% |
| natural-language-inference-on-qnli-glue-dev | DistilBERT | #15 | Accuracy: 89.2 |
| natural-language-inference-on-multinli-dev | DistilBERT | #17 | Matched: 82.2 |
| question-answering-on-squad11-dev | DistilBERT | #20 | EM: 77.7 |
| question-answering-on-squad11-dev | DistilBERT 66M | #44 | F1: 85.8 |
| task-1-grouping-on-ocw | DistilBERT (BASE) | #21 | # Correct Groups: 49 ± 4Fowlkes Mallows Score (FMS): 29.1 ± .2… |
| natural-language-inference-on-wnli | DistilBERT 66M | #23 | Accuracy: 44.4 |
| sentiment-analysis-on-imdb | DistilBERT 66M | #28 | Accuracy: 92.82 |
| linguistic-acceptability-on-cola | DistilBERT 66M | #34 | Accuracy: 49.1% |
| natural-language-inference-on-qnli | DistilBERT 66M | #35 | Accuracy: 90.2% |
| sentiment-analysis-on-sst-2-binary-classification | DistilBERT 66M | #54 | Accuracy: 91.3 |
| natural-language-inference-on-rte | DistilBERT 66M | #64 | Accuracy: 62.9% |