| linguistic-acceptability-on-cola | MLM+ del-span+ reorder | – | Accuracy: 64.3% |
| natural-language-inference-on-qnli | MLM+ subs+ del-span | – | Accuracy: 93.4% |
| natural-language-inference-on-rte | MLM+ del-span | – | Accuracy: 79.8% |
| question-answering-on-quora-question-pairs | MLM+ subs+ del-span | – | Accuracy: 90.3% |
| semantic-textual-similarity-on-mrpc | MLM+ del-word+ reorder | – | Accuracy: 90.6% |
| semantic-textual-similarity-on-sts-benchmark | MLM+ del-word | – | Pearson Correlation: 0.905 |
| sentiment-analysis-on-sst-2-binary-classification | MLM+ del-word+ reorder | – | Accuracy: 94.5 |