Semantics-aware BERT for Language Understanding

Benchmark Model Rank Results
natural-language-inference-on-snliSemBERT#6% Test Accuracy: 91.9% Train Accuracy: 94.4Parameters: 339m
question-answering-on-squad20SemBERT(ensemble)#14EM: 86.166F1: 88.886
question-answering-on-squad20SemBERT (ensemble)#15EM: 86.166F1: 88.886
question-answering-on-squad20SemBERT (single model)#18EM: 84.800F1: 87.864
question-answering-on-squad20-devSemBERT large#8F1: 83.6EM: 80.9