GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models

Benchmark Model Rank Results
agents-on-taubench-airlineGLM-4.5 (355B)#1Accuracy: 60.4
agents-on-taubench-retailGLM-4.5 (355B)#1Accuracy: 79.7
multi-task-language-understanding-on-mmluGLM-4.5 (355B)#1Average (%): 90.0
code-generation-on-livecodebench-v5GLM-4.5 (355B)#3Pass@1: 72.9
code-generation-on-livecodebench-v5GLM-4.5-Air#6Pass@1: 70.7
question-answering-on-simpleqaGLM-4.5 (355B)#4Accuracy: 26.4
mathematical-reasoning-on-math-500GLM-4.5 (355B)#5Accuracy: 98.2
mathematical-reasoning-on-math-500GLM-4.5-Air#6Accuracy: 98.1
instruction-following-on-multichallengeGLM-4.5 (355B)#12Accuracy: 52.8
code-generation-on-scicodeGLM-4.5 (355B)#13Accuracy: 41.7
code-generation-on-scicodeGLM-4.5-Air#17Accuracy: 37.3
mathematical-reasoning-on-aime24GLM-4.5-Air#13Acc: 89.4
multi-task-language-understanding-on-mmlu-proGLM-4.5 (355B)#19Accuracy: 84.6
multi-task-language-understanding-on-mmlu-proGLM-4.7#21Accuracy: 84.3
multi-task-language-understanding-on-mmlu-proGLM-4.5-Air#37Accuracy: 81.4
question-answering-on-humanity-s-last-exam-hleGLM-4.7#19Accuracy: 24.8
question-answering-on-humanity-s-last-exam-hleGLM-4.5 (355B)#36Accuracy: 14.4
question-answering-on-humanity-s-last-exam-hleGLM-4.5-Air#40Accuracy: 10.6
multiple-choice-question-answering-mcqa-on-gpqa-diamondGLM-4.7#33Accuracy: 85.7
code-generation-on-swe-bench-verifiedGLM-4.5 (355B) (OpenHands)#56Accuracy: 64.2
code-generation-on-swe-bench-verifiedGLM-4.5-Air (OpenHands)#68Accuracy: 57.6
deep-research-agents-on-browsecompGLM-4.5 (355B)#58Accuracy: 26.4
deep-research-agents-on-browsecompGLM-4.5-Air#61Accuracy: 21.3