Chartography Leaderboard

Benchmark Model Rank Results
chart-question-answering-on-chartography-no-toolsGPT-5.6 Sol (no tools)#2Pass@1: 0.45
chart-question-answering-on-chartography-no-toolsGemini 3.8 Flash (no tools)#3Pass@1: 0.409
chart-question-answering-on-chartography-no-toolsGemini 3.7 Flash (no tools)#4Pass@1: 0.404
chart-question-answering-on-chartography-no-toolsClaude Fable 5 (no tools)#5Pass@1: 0.348
chart-question-answering-on-chartography-no-toolsGPT-5.6 Terra (no tools)#6Pass@1: 0.34
chart-question-answering-on-chartography-no-toolsGPT-5.6 Luna (no tools)#7Pass@1: 0.314
chart-question-answering-on-chartography-no-toolsQwen3.8-Max (no tools)#8Pass@1: 0.291
chart-question-answering-on-chartography-no-toolsClaude Opus 5 (no tools)#9Pass@1: 0.273
chart-question-answering-on-chartography-no-toolsKimi K3 (no tools)#10Pass@1: 0.266
chart-question-answering-on-chartography-no-toolsMuse Spark 1.1 (no tools)#11Pass@1: 0.244
chart-question-answering-on-chartography-no-toolsQwen3.8-Flash (no tools)#12Pass@1: 0.174
chart-question-answering-on-chartography-no-toolsMuse Glimmer-30B (no tools)#13Pass@1: 0.172
chart-question-answering-on-chartography-no-toolsGLM-5.3-Flash (no tools)#14Pass@1: 0.163
chart-question-answering-on-chartography-no-toolsQwen3.5-Plus (no tools)#15Pass@1: 0.159
chart-question-answering-on-chartography-no-toolsKimi K2.5 (no tools)#16Pass@1: 0.126
chart-question-answering-on-chartography-no-toolsKimi K2.6 (no tools)#17Pass@1: 0.122
chart-question-answering-on-chartography-no-toolsDeepSeek-V4.1-Flash (no tools)#18Pass@1: 0.116
chart-question-answering-on-chartography-no-toolsInkling (no tools)#19Pass@1: 0.1
chart-question-answering-on-chartography-no-toolsInkling-Small (no tools)#20Pass@1: 0.091
chart-question-answering-on-chartography-no-toolsMistral Large 3 (no tools)#21Pass@1: 0.09
chart-question-answering-on-chartography-no-toolsClaude Opus 4.7 (no tools)–Pass@1: 0.165
chart-question-answering-on-chartography-no-toolsClaude Opus 4.8 (no tools)–Pass@1: 0.159
chart-question-answering-on-chartography-no-toolsClaude Sonnet 5 (no tools)–Pass@1: 0.166
chart-question-answering-on-chartography-no-toolsGPT-5.4 (no tools)–Pass@1: 0.296
chart-question-answering-on-chartography-no-toolsGPT-5.5 (no tools)–Pass@1: 0.31
chart-question-answering-on-chartography-no-toolsGPT-6 Luna (no tools)–Pass@1: 0.291
chart-question-answering-on-chartography-no-toolsGPT-6 Sol (no tools)–Pass@1: 0.536
chart-question-answering-on-chartography-no-toolsGemini 3.1 Pro (no tools)–Pass@1: 0.261
chart-question-answering-on-chartography-no-toolsGemini 3.5 Flash-Lite (no tools)–Pass@1: 0.102
chart-question-answering-on-chartography-no-toolsGemini 3.6 Flash (no tools)–Pass@1: 0.34
chart-question-answering-on-chartography-no-toolsGrok 4.3 (no tools)–Pass@1: 0.129
chart-question-answering-on-chartography-no-toolsGrok 4.5 (no tools)–Pass@1: 0.17
chart-question-answering-on-chartography-no-toolsGrok 4.6 (no tools)–Pass@1: 0.205
chart-question-answering-on-chartography-no-toolsGrok 4.7 (no tools)–Pass@1: 0.147
chart-question-answering-on-chartography-no-toolsMuse Spark 1.2 (no tools)–Pass@1: 0.321
chart-question-answering-on-chartography-no-toolsMuse Spark 1.3 (no tools)–Pass@1: 0.276
chart-question-answering-on-chartography-no-toolsQwen3.7-Plus (no tools)–Pass@1: 0.158