Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehension

Benchmark Model Rank Results
question-answering-on-fairytaleqaBART fine-tuned on FairytaleQA#1F1: 0.536Rouge-L: 0.533
question-answering-on-fairytaleqaBART fine-tuned on NarrativeQA#2F1: 0.492Rouge-L: 0.475
question-answering-on-fairytaleqaBART#3F1: 0.088Rouge-L: 0.108
question-answering-on-fairytaleqaDistilBERT#4F1: 0.082Rouge-L: 0.097
question-generation-on-fairytaleqaBART fine-tuned on FairytaleQA#1ROUGE-L: 0.527
question-generation-on-fairytaleqaBART fine-tuned on NarrativeQA and FairytaleQA#2ROUGE-L: 0.519
question-generation-on-fairytaleqaBART fine-tuned on NarrativeQA#3ROUGE-L: 0.442