SocialIQA: Commonsense Reasoning about Social Interactions

Benchmark Model Rank Results
coreference-resolution-on-winograd-schemaBERT-SocialIQA 340M#25Accuracy: 72.5
coreference-resolution-on-winograd-schemaBERT-large 340M#34Accuracy: 67
question-answering-on-copaBERT-SocialIQA 340M#30Accuracy: 83.4
question-answering-on-copaBERT-large 340M#33Accuracy: 80.8
question-answering-on-social-iqaBERT-large 340M (fine-tuned)#13Accuracy: 64.5
question-answering-on-social-iqaBERT-base 110M (fine-tuned)#14Accuracy: 63.1
question-answering-on-social-iqaGPT-1 117M (fine-tuned)#15Accuracy: 63
question-answering-on-social-iqaRandom chance baseline#24Accuracy: 33.3