QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers

Benchmark Model Rank Results
knowledge-base-question-answering-on-qald-9-plusQAnswer-Wikidata-English#1Macro F1: 0.4459
knowledge-base-question-answering-on-qald-9-plusQAnswer-Wikidata-German#2Macro F1: 0.3171
knowledge-base-question-answering-on-qald-9-plusQAnswer-DBpedia-English#3Macro F1: 0.3039
knowledge-base-question-answering-on-qald-9-plusQAnswer-Wikidata-French#4Macro F1: 0.23
knowledge-base-question-answering-on-qald-9-plusQAnswer-Wikidata-Russian#5Macro F1: 0.2143
knowledge-base-question-answering-on-qald-9-plusQAnswer-DBpedia-German#6Macro F1: 0.1998
knowledge-base-question-answering-on-qald-9-plusQAnswer-DBpedia-French#7Macro F1: 0.1506
knowledge-base-question-answering-on-qald-9-plusPlatypus-Wikidata-English#8Macro F1: 0.1503
knowledge-base-question-answering-on-qald-9-plusDeepPavlov-Wikidata-English#9Macro F1: 0.124
knowledge-base-question-answering-on-qald-9-plusQAnswer-DBpedia-Russian#10Macro F1: 0.0957
knowledge-base-question-answering-on-qald-9-plusDeepPavlov-Wikidata-Russian#11Macro F1: 0.087
knowledge-base-question-answering-on-qald-9-plusPlatypus-Wikidata-French#12Macro F1: 0.0417