BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions

Benchmark Model Rank Results
question-answering-on-boolqBERT-MultiNLI 340M (fine-tuned)#43Accuracy: 80.4
question-answering-on-boolqBiDAF-MultiNLI (fine-tuned)#56Accuracy: 75.57
question-answering-on-boolqGPT-1 117M (fine-tuned)#63Accuracy: 72.87
question-answering-on-boolqBiDAF + ELMo (fine-tuned)#66Accuracy: 71.41
question-answering-on-boolqMajority baseline#87Accuracy: 62.17