OpenCodePapers

visual-question-answering-on-iconqa

Visual Question Answering (VQA)

Results over time

Click legend items to toggle metrics. Hover points for model names.

Leaderboard

Paper	Code	Sub-tasks (Img.)	Sub-tasks (Txt.)	Sub-tasks (Blank)	Reasoning (Geo.)	Reasoning (Cou.)	Reasoning (Com.)	Reasoning (Spa.)	Reasoning (Sce.)	Reasoning (Pat.)	Reasoning (Tim.)	Reasoning (Fra.)	Reasoning (Est.)	Reasoning (Alg.)	Reasoning (Mea.)	Reasoning (Sen.)	Reasoning (Pro.)	ModelName	ReleaseDate
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	82.66	75.19	83.62	81.87	77.81	87.00	55.62	62.39	68.75	77.98	82.13	98.24	56.73	97.98	92.49	95.73	Patch-TRM	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	79.67	72.69	79.27	82.61	71.13	84.95	53.38	66.72	59.22	69.99	75.81	99.02	50.55	98.91	86.10	87.65	ViLT	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	79.15	72.34	78.92	82.60	70.84	82.12	54.64	68.80	58.46	68.66	77.41	98.95	51.10	98.76	84.72	86.07	ViT	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	78.71	72.39	78.53	81.31	71.01	83.67	48.34	61.25	60.81	69.77	78.37	99.41	49.18	99.38	86.10	87.84	UNITER	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	77.72	72.17	78.28	81.80	70.68	81.69	51.42	67.01	56.60	67.72	77.60	99.02	50.27	98.83	84.11	85.70	DFAF	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	77.36	71.25	74.52	79.86	68.94	82.73	49.70	62.49	54.79	68.00	76.20	99.08	47.32	98.99	83.25	84.87	MCAN	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	76.66	70.47	77.08	80.05	71.05	75.60	49.46	58.52	62.78	66.72	74.09	99.22	50.62	99.07	81.78	70.94	ViLBERT	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	76.33	70.82	75.54	79.99	67.56	82.12	53.20	66.92	55.67	66.50	73.77	97.06	47.46	96.50	82.12	82.45	BAN	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	75.92	68.51	73.03	80.07	65.01	80.65	45.78	58.22	55.01	68.28	72.43	99.54	50.00	99.46	84.54	83.75	Top-Down	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	41.70	36.87	0.29	30.30	18.38	41.20	36.49	34.25	34.81	35.82	34.84	3.62	11.12	0.36	45.16	38.81	Random	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	41.64	36.86	28.45	38.03	33.63	48.19	37.14	35.37	33.66	48.09	33.06	40.46	28.02	38.07	45.25	40.76	Q-Only	2021-10-25
IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning	✓ Link	41.56	36.02	46.65	38.71	37.64	45.26	37.52	35.47	36.29	47.37	32.48	62.29	31.73	64.02	45.25	37.51	I-Only	2021-10-25