ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

Benchmark Model Rank Results
instruction-following-on-alignbenchGLM-4 (0520)#4Score (0-10): 8.00
instruction-following-on-mtbenchGLM-4-9B-Chat#9Score (1-10): 8.35
multi-task-language-understanding-on-mmmluGLM-4-9B-Chat#13Accuracy: 56.6
multi-task-language-understanding-on-c-evalGLM-4-9B-Chat#21Accuracy: 75.6
arithmetic-reasoning-on-gsm8kGLM-4 (0520)#40Accuracy: 93.3
math-word-problem-solving-on-mathGLM-4 (0520)#47Accuracy: 61.3
code-generation-on-humanevalGLM-4 (0520)#68Pass@1: 78.5