| linguistic-acceptability-on-cola-dev | TinyBERT-6 67M | #4 | Accuracy: 54 |
| natural-language-inference-on-multinli-dev | TinyBERT-6 67M | #13 | Matched: 84.5Mismatched: 84.5 |
| paraphrase-identification-on-quora-question-pairs | TinyBERT | #14 | F1: 71.3 |
| question-answering-on-squad11-dev | TinyBERT-6 67M | #15 | EM: 79.7F1: 87.5 |
| question-answering-on-squad20-dev | TinyBERT-6 67M | #18 | F1: 73.4EM: 69.9 |
| semantic-textual-similarity-on-sts-benchmark | TinyBERT-4 14.5M | #22 | Pearson Correlation: 0.799 |
| semantic-textual-similarity-on-mrpc | TinyBERT-6 67M | #23 | Accuracy: 87.3% |
| semantic-textual-similarity-on-mrpc | TinyBERT-4 14.5M | #27 | Accuracy: 86.4% |
| natural-language-inference-on-multinli | TinyBERT-6 67M | #27 | Matched: 84.6Mismatched: 83.2 |
| natural-language-inference-on-multinli | TinyBERT-4 14.5M | #31 | Matched: 82.5Mismatched: 81.8 |
| natural-language-inference-on-qnli | TinyBERT-6 67M | #33 | Accuracy: 90.4% |
| natural-language-inference-on-qnli | TinyBERT-4 14.5M | #39 | Accuracy: 87.7% |
| linguistic-acceptability-on-cola | TinyBERT-4 14.5M | #37 | Accuracy: 43.3% |
| sentiment-analysis-on-sst-2-binary-classification | TinyBERT-6 67M | #41 | Accuracy: 93.1 |
| sentiment-analysis-on-sst-2-binary-classification | TinyBERT-4 14.5M | #45 | Accuracy: 92.6 |
| natural-language-inference-on-rte | TinyBERT-6 67M | #60 | Accuracy: 66% |
| natural-language-inference-on-rte | TinyBERT-4 14.5M | #63 | Accuracy: 62.9% |