WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations

Benchmark Model Rank Results
word-sense-disambiguation-on-words-in-contextBERT-large 340M–Accuracy: 65.5
word-sense-disambiguation-on-words-in-contextContext2vec–Accuracy: 59.3
word-sense-disambiguation-on-words-in-contextDeConf–Accuracy: 58.7
word-sense-disambiguation-on-words-in-contextElMo–Accuracy: 57.7
word-sense-disambiguation-on-words-in-contextSW2V–Accuracy: 58.1
word-sense-disambiguation-on-words-in-contextSentence LSTM–Accuracy: 53.1