ERNIE 2.0: A Continual Pre-training Framework for Language Understanding

Benchmark Model Rank Results
chinese-named-entity-recognition-on-msraERNIE 2.0 Large#10F1: 95
chinese-named-entity-recognition-on-msraERNIE 2.0 Base#15F1: 93.8
linguistic-acceptability-on-colaERNIE 2.0 Large#19Accuracy: 63.5%
linguistic-acceptability-on-colaERNIE 2.0 Base#26Accuracy: 55.2%
natural-language-inference-on-multinliERNIE 2.0 Large#11Matched: 88.7Mismatched: 88.8
natural-language-inference-on-multinliERNIE 2.0 Base#23Matched: 86.1Mismatched: 85.5
natural-language-inference-on-qnliERNIE 2.0 Large#12Accuracy: 94.6%
natural-language-inference-on-qnliERNIE 2.0 Base#19Accuracy: 92.9%
natural-language-inference-on-rteERNIE 2.0 Large#30Accuracy: 80.2%
natural-language-inference-on-rteERNIE 2.0 Base#39Accuracy: 74.8%
natural-language-inference-on-wnliERNIE 2.0 Large#17Accuracy: 67.8
question-answering-on-quora-question-pairsERNIE 2.0 Large#6Accuracy: 90.1%
question-answering-on-quora-question-pairsERNIE 2.0 Base#9Accuracy: 89.8%
semantic-textual-similarity-on-mrpcERNIE 2.0 Large#22Accuracy: 87.4%
semantic-textual-similarity-on-mrpcERNIE 2.0 Base#28Accuracy: 86.1%
semantic-textual-similarity-on-sts-benchmarkERNIE 2.0 Large#9Pearson Correlation: 0.912
semantic-textual-similarity-on-sts-benchmarkERNIE 2.0 Base#17Pearson Correlation: 0.876
sentiment-analysis-on-sst-2-binaryERNIE 2.0 Base#24Accuracy: 95