Qwen3-VL Technical Report

Benchmark Model Rank Results
multi-task-language-understanding-on-livebench-2024-11-25Qwen3-VL-235B-A22B-Thinking#1Score: 79.6
text-generation-on-writingbenchQwen3-VL-235B-A22B-Thinking#1Score (0-10): 8.67
visual-question-answering-on-docvqa-testQwen3-VL-235B-A22B-Instruct#1ANLS: 0.971
visual-question-answering-vqa-on-infographicvqaQwen3-VL-235B-A22B-Thinking#1ANLS: 89.5
chart-question-answering-on-charxiv-dqQwen3-VL-235B-A22B-Thinking#2Accuracy: 90.5
instruction-following-on-arena-hard-auto-v2Qwen3-VL-235B-A22B-Instruct#2Accuracy: 77.4
optical-character-recognition-ocr-on-ocrbench-v2Qwen3-VL-32B-Thinking#2English Score: 68.4
optical-character-recognition-ocr-on-ocrbench-v2Qwen3-VL-235B-A22B-Thinking#8Chinese Score: 63.5
visual-question-answering-vqa-on-ai2d-test-with-maskQwen3-VL-235B-A22B-Instruct#2Accuracy: 89.7
instruction-following-on-multi-ifQwen3-VL (235B-A22B, Thinking)#3Accuracy: 79.1
optical-character-recognition-ocr-on-ocrbenchQwen3-VL-235B-A22B-Instruct#3Score: 920
optical-character-recognition-ocr-on-omnidocbench-v1-0Qwen3-VL-235B-A22B-Instruct#3Edit Distance: 0.143
visual-grounding-on-refcoco-refcoco-refcocog-overallQwen3-VL-235B-A22B-Thinking#3Accuracy: 92.1
visual-question-answering-vqa-on-mmbench-cnQwen3-VL-235B-A22B-Instruct#3Accuracy: 88.9
computer-use-agents-on-osw-g-osworld-gQwen3-VL-235B-A22B-Thinking#4Accuracy: 68.3
multi-task-language-understanding-on-mmlu-reduxQwen3-VL-235B-A22B-Thinking#4Accuracy: 93.7
visual-question-answering-vqa-on-simplevqaQwen3-VL-235B-A22B-Instruct#4Accuracy: 63.0
zero-shot-object-detection-on-odinw13Qwen3-VL-235B-A22B-Instruct (zero-shot)#4mAP: 48.6
multi-task-language-understanding-on-includeQwen3-VL-235B-A22B-Thinking#5Accuracy: 80.0
multimodal-reasoning-on-zerobenchQwen3-VL-235B-A22B-Thinking#6Accuracy: 4
video-question-answering-on-mvbenchQwen3-VL-235B-A22B-Instruct#6Avg.: 76.5
visual-question-answering-vqa-on-blinkQwen3-VL-235B-A22B-Instruct#6Accuracy: 70.7
zero-shot-video-question-answer-on-video-mme-w-o-subsQwen3-VL-235B-A22B-Instruct#6Accuracy (%): 79.2
chart-question-answering-on-chartqaQwen3-VL-235B-A22B-Thinking#71:1 Accuracy: 90.3
multiple-choice-question-answering-mcqa-on-supergpqaQwen3-VL-235B-A22B-Thinking#7Accuracy: 64.3
visual-question-answering-vqa-on-hallusionbench-average-accuracyQwen3-VL-235B-A22B-Thinking#7Accuracy: 66.7
multimodal-reasoning-on-mmmuQwen3-VL-235B-A22B-Thinking#9Accuracy: 80.6
video-question-answering-on-mlvuQwen3-VL-235B-A22B-Instruct#9Accuracy: 84.3
multimodal-reasoning-on-mathvistaQwen3-VL-235B-A22B-Thinking#10Accuracy: 85.8
object-counting-on-countbenchQwen3-VL-235B-A22B-Thinking#11Accuracy: 93.7
video-question-answering-on-mmvuQwen3-VL-235B-A22B-Thinking#11Accuracy: 71.1
video-question-answering-on-video-mmmuQwen3-VL-235B-A22B-Thinking#11Accuracy: 80.0
computer-use-agents-on-screenspot-proQwen3-VL-235B-A22B-Instruct#12Accuracy: 62.0
vision-language-understanding-on-mmbench-v1-1Qwen3-VL-8B-Instruct#12Accuracy: 85.0
visual-question-answering-vqa-on-realworldqaQwen3-VL-235B-A22B-Thinking#12Accuracy: 81.3
vision-language-understanding-on-mmstarQwen3-VL-235B-A22B-Thinking#13Accuracy: 78.7
chart-question-answering-on-charxiv-rqQwen3-VL-235B-A22B-Thinking#14Accuracy: 66.1
multimodal-reasoning-on-mathvisionQwen3-VL-235B-A22B-Thinking#15Accuracy: 74.6
video-question-answering-on-lvbenchQwen3-VL-235B-A22B-Instruct#15Accuracy: 67.7
visual-question-answering-vqa-on-mmbench-enQwen3-VL-4B-Instruct#18Accuracy: 83.9
computer-use-agents-on-androidworldQwen3-VL-235B-A22B-Instruct#19Success Rate: 63.7
multimodal-reasoning-on-mmmu-proQwen3-VL-235B-A22B-Thinking#20Accuracy: 69.3
mathematical-reasoning-on-aime-2025Qwen3-VL-235B-A22B-Thinking#24Accuracy: 89.7
multi-task-language-understanding-on-mmlu-proQwen3-VL-235B-A22B-Thinking#25Accuracy: 83.8
code-generation-on-livecodebench-v6Qwen3-VL-235B-A22B-Thinking#33Pass@1: 70.1