ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Benchmark Model Rank Results
linguistic-acceptability-on-cola-glue-devELECTRA-1.75M#2Matthews Correlation: 69.1
natural-language-inference-on-rte-glue-devELECTRA-1.75M#2Accuracy: 88.0
semantic-textual-similarity-on-sts-b-glue-devELECTRA-1.75M#2Pearson/Spearman Correlation: 92.6
natural-language-inference-on-multinli-devELECTRA-1.75M#3Matched: 90.9
natural-language-inference-on-qnli-glue-devELECTRA-1.75M#3Accuracy: 95.0
natural-language-understanding-on-glue-devELECTRA-1.75M#4GLUE (dev): 89.5
natural-language-understanding-on-glue-testELECTRA-1.75M#4GLUE (test): 89.4
natural-language-inference-on-wnliELECTRA-1.75M#5Accuracy: 92.5
paraphrase-identification-on-mrpc-glue-devELECTRA-1.75M#5F1: 90.8
question-answering-on-quora-question-pairsELECTRA#7Accuracy: 90.1%
linguistic-acceptability-on-colaELECTRA-1.75M#8Accuracy: 71.7%
natural-language-inference-on-qnliELECTRA-1.75M#8Accuracy: 95.8%
sentiment-analysis-on-sst-2-binary-classificationELECTRA#8Accuracy: 96.9
natural-language-inference-on-rteELECTRA-1.75M#15Accuracy: 89.8%
question-answering-on-squad20ELECTRA-1.75M#28F1: 91.4
paraphrase-identification-on-quora-question-pairsELECTRA-1.75M#32Accuracy: 90.8
question-answering-on-squad11-devELECTRA-1.75M#49F1: 94.9