Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding

Benchmark Model Rank Results
image-captioning-on-textcapsPix2Struct Large#6CIDEr: 95.5
visual-question-answering-vqa-on-infographicvqaPix2Struct-large#25ANLS: 40
visual-question-answering-vqa-on-infographicvqaPix2Struct-base#26ANLS: 38.2
visual-question-answering-on-docvqa-testPix2Struct-large#75ANLS: 0.766
visual-question-answering-on-docvqa-testPix2Struct-base#82ANLS: 0.721
chart-question-answering-on-chartqaPix2Struct-large#1091:1 Accuracy: 58.6
chart-question-answering-on-chartqaPix2Struct-base#1111:1 Accuracy: 56.0