ERNIE: Enhanced Language Representation with Informative Entities

Benchmark Model Rank Results
relation-classification-on-tacredBERT#4F1: 66.0
relation-classification-on-tacredERNIE#6F1: 68.0
paraphrase-identification-on-quora-question-pairsERNIE#15F1: 71.2
semantic-textual-similarity-on-mrpcERNIE#16Accuracy: 88.2%
semantic-textual-similarity-on-sts-benchmarkERNIE#20Pearson Correlation: 0.832
relation-extraction-on-tacredERNIE#23F1: 67.97
natural-language-inference-on-multinliERNIE#29Matched: 84.0Mismatched: 83.2
natural-language-inference-on-qnliERNIE#29Accuracy: 91.3%
linguistic-acceptability-on-colaERNIE#30Accuracy: 52.3%
sentiment-analysis-on-sst-2-binary-classificationERNIE#38Accuracy: 93.5
natural-language-inference-on-rteERNIE#56Accuracy: 68.8%