MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering

Benchmark Model Rank Results
chart-question-answering-on-plotqaMatCha#11:1 Accuracy: 91.5
chart-question-answering-on-realcqaMatcha-chartQA#31:1 Accuracy: 0.259728175283818
image-captioning-on-textcapsMATCHA#7CIDEr: 92.4
visual-question-answering-vqa-on-infographicvqaMatCha#27ANLS: 37.2
visual-question-answering-on-docvqa-testMatCha#79ANLS: 0.742
chart-question-answering-on-chartqaMatCha#1061:1 Accuracy: 64.2