WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations

Benchmark Model Rank Results
word-sense-disambiguation-on-words-in-contextBERT-large 340MAccuracy: 65.5
word-sense-disambiguation-on-words-in-contextContext2vecAccuracy: 59.3
word-sense-disambiguation-on-words-in-contextDeConfAccuracy: 58.7
word-sense-disambiguation-on-words-in-contextElMoAccuracy: 57.7
word-sense-disambiguation-on-words-in-contextSW2VAccuracy: 58.1
word-sense-disambiguation-on-words-in-contextSentence LSTMAccuracy: 53.1