SenseBERT: Driving Some Sense into BERT

Benchmark Model Rank Results
natural-language-inference-on-qnliSenseBERT-base 110M–Accuracy: 90.6%
natural-language-inference-on-rteSenseBERT-base 110M–Accuracy: 67.5%
word-sense-disambiguation-on-words-in-contextSenseBERT-base 110M–Accuracy: 70.3
word-sense-disambiguation-on-words-in-contextSenseBERT-large 340M–Accuracy: 72.1