| linguistic-acceptability-on-cola | TinyBERT-4 14.5M | #32 | Accuracy: 43.3% |
| linguistic-acceptability-on-cola-dev | TinyBERT-6 67M | #4 | Accuracy: 54 |
| natural-language-inference-on-multinli | TinyBERT-6 67M | #26 | Matched: 84.6Mismatched: 83.2 |
| natural-language-inference-on-multinli | TinyBERT-4 14.5M | #30 | Matched: 82.5Mismatched: 81.8 |
| natural-language-inference-on-multinli-dev | TinyBERT-6 67M | #1 | Matched: 84.5Mismatched: 84.5 |
| natural-language-inference-on-qnli | TinyBERT-6 67M | #28 | Accuracy: 90.4% |
| natural-language-inference-on-qnli | TinyBERT-4 14.5M | #33 | Accuracy: 87.7% |
| natural-language-inference-on-rte | TinyBERT-6 67M | #56 | Accuracy: 66% |
| natural-language-inference-on-rte | TinyBERT-4 14.5M | #59 | Accuracy: 62.9% |
| paraphrase-identification-on-quora-question | TinyBERT | #13 | F1: 71.3 |
| question-answering-on-squad11-dev | TinyBERT-6 67M | #15 | EM: 79.7F1: 87.5 |
| question-answering-on-squad20-dev | TinyBERT-6 67M | #12 | F1: 73.4EM: 69.9 |
| semantic-textual-similarity-on-mrpc | TinyBERT-6 67M | #23 | Accuracy: 87.3% |
| semantic-textual-similarity-on-mrpc | TinyBERT-4 14.5M | #27 | Accuracy: 86.4% |
| semantic-textual-similarity-on-sts-benchmark | TinyBERT-4 14.5M | #22 | Pearson Correlation: 0.799 |
| sentiment-analysis-on-sst-2-binary | TinyBERT-6 67M | #39 | Accuracy: 93.1 |
| sentiment-analysis-on-sst-2-binary | TinyBERT-4 14.5M | #42 | Accuracy: 92.6 |