Qwen3.6

Benchmark Model Rank Results
visual-grounding-on-refcoco-refcoco-refcocog-overallQwen3.6-27B#1Accuracy: 92.5
visual-grounding-on-refcoco-refcoco-refcocog-overallQwen3.6-35B-A3B#4Accuracy: 92.0
code-generation-on-terminal-bench-2-0-terminus-2Qwen3.6-27B (Terminus-2)#2Accuracy: 59.3
code-generation-on-terminal-bench-2-0-terminus-2Qwen3.6-35B-A3B (Terminus-2)#5Accuracy: 51.5
video-question-answering-on-mlvuQwen3.6-27B#3Accuracy: 86.6
video-question-answering-on-mlvuQwen3.6-35B-A3B#4Accuracy: 86.2
video-question-answering-on-video-mme-with-subtitlesQwen3.6-27B#3Accuracy: 87.7
video-question-answering-on-video-mme-with-subtitlesQwen3.6-35B-A3B#9Accuracy: 86.6
vision-language-understanding-on-mmbench-v1-1Qwen3.6-35B-A3B#3Accuracy: 92.8
vision-language-understanding-on-mmbench-v1-1Qwen3.6-27B#5Accuracy: 92.3
agents-on-claw-evalQwen3.6-27B#4Accuracy: 72.4
agents-on-claw-evalQwen3.6-35B-A3B#6Accuracy: 68.7
multiple-choice-question-answering-mcqa-on-supergpqaQwen3.6-27B#4Accuracy: 66.0
multiple-choice-question-answering-mcqa-on-supergpqaQwen3.6-35B-A3B#6Accuracy: 64.7
object-counting-on-countbenchQwen3.6-27B#4Accuracy: 97.8
object-counting-on-countbenchQwen3.6-35B-A3B#8Accuracy: 96.1
visual-question-answering-vqa-on-realworldqaQwen3.6-35B-A3B#4Accuracy: 85.3
visual-question-answering-vqa-on-realworldqaQwen3.6-27B#7Accuracy: 84.1
multi-task-language-understanding-on-c-evalQwen3.6-27B#5Accuracy: 91.4
multi-task-language-understanding-on-c-evalQwen3.6-35B-A3B#12Accuracy: 90.0
multi-task-language-understanding-on-mmlu-reduxQwen3.6-27B#5Accuracy: 93.5
multi-task-language-understanding-on-mmlu-reduxQwen3.6-35B-A3B#7Accuracy: 93.3
multimodal-reasoning-on-mathvistaQwen3.6-27B#5Accuracy: 87.4
multimodal-reasoning-on-mathvistaQwen3.6-35B-A3B#7Accuracy: 86.4
multimodal-reasoning-on-mmmuQwen3.6-27B#5Accuracy: 82.9
multimodal-reasoning-on-mmmuQwen3.6-35B-A3B#7Accuracy: 81.7
video-question-answering-on-video-mmmuQwen3.6-27B#5Accuracy: 84.4
video-question-answering-on-video-mmmuQwen3.6-35B-A3B#6Accuracy: 83.7
vision-language-understanding-on-mmstarQwen3.6-27B#6Accuracy: 81.4
vision-language-understanding-on-mmstarQwen3.6-35B-A3B#9Accuracy: 80.7
chart-question-answering-on-charxiv-rqQwen3.6-27B#7Accuracy: 78.4
chart-question-answering-on-charxiv-rqQwen3.6-35B-A3B#8Accuracy: 78.0
optical-character-recognition-ocr-on-ocrbenchQwen3.6-35B-A3B#7Score: 900
video-question-answering-on-mvbenchQwen3.6-27B#8Avg.: 75.5
video-question-answering-on-mvbenchQwen3.6-35B-A3B#14Avg.: 74.6
multi-task-language-understanding-on-mmlu-proQwen3.6-27B#9Accuracy: 86.2
multi-task-language-understanding-on-mmlu-proQwen3.6-35B-A3B#14Accuracy: 85.2
multimodal-reasoning-on-mmmu-proQwen3.6-27B#9Accuracy: 75.8
multimodal-reasoning-on-mmmu-proQwen3.6-35B-A3B#10Accuracy: 75.3
mathematical-reasoning-on-aime-2026Qwen3.6-27B#11Accuracy: 94.1
mathematical-reasoning-on-aime-2026Qwen3.6-35B-A3B#15Accuracy: 92.7
code-generation-on-livecodebench-v6Qwen3.6-27B#13Pass@1: 83.9
code-generation-on-livecodebench-v6Qwen3.6-35B-A3B#18Pass@1: 80.4
computer-use-agents-on-androidworldQwen3.6-27B#15Success Rate: 70.3
code-generation-on-swe-bench-verifiedQwen3.6-27B (Internal agent scaffold)#17Accuracy: 77.2
code-generation-on-swe-bench-verifiedQwen3.6-35B-A3B (Internal agent scaffold)#30Accuracy: 73.4
code-generation-on-swe-bench-multilingualQwen3.6-27B (Internal agent scaffold)#20Accuracy: 71.3
code-generation-on-swe-bench-multilingualQwen3.6-35B-A3B (Internal agent scaffold)#26Accuracy: 67.2
multiple-choice-question-answering-mcqa-on-gpqa-diamondQwen3.6-27B#20Accuracy: 87.8
multiple-choice-question-answering-mcqa-on-gpqa-diamondQwen3.6-35B-A3B#30Accuracy: 86.0
question-answering-on-humanity-s-last-exam-hleQwen3.6-27B#21Accuracy: 24.0
question-answering-on-humanity-s-last-exam-hleQwen3.6-35B-A3B#27Accuracy: 21.4
code-generation-on-swe-bench-proQwen3.6-27B#29Resolved: 53.5
code-generation-on-swe-bench-proQwen3.6-35B-A3B#33Resolved: 49.5