ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Open paper

Benchmark	Model	Rank	Results
question-answering-on-quora-question-pairs	ELECTRA	#7	Accuracy: 90.1%
sentiment-analysis-on-sst-2-binary	ELECTRA	#7	Accuracy: 96.9