QLEVR: A Diagnostic Dataset for Quantificational Language and Elementary Visual Reasoning

Benchmark Model Rank Results
visual-question-answering-on-qlevrMAC#1Overall Accuracy: 66.5
visual-question-answering-on-qlevrCNN+LSTM#2Overall Accuracy: 65.9
visual-question-answering-on-qlevrBERT#3Overall Accuracy: 65.8
visual-question-answering-on-qlevrLSTM#4Overall Accuracy: 64.6
visual-question-answering-on-qlevrQ-type#5Overall Accuracy: 50.0