Gemma 4 Technical Report

Benchmark Model Rank Results
infographic-visual-question-answering-on-infovqaGemma 4 31B#1ANLS: 92.0
infographic-visual-question-answering-on-infovqaGemma 4 26B-A4B#3ANLS: 89.3
long-context-understanding-on-mrcr-v2-128kGemma 4 31B#2Accuracy: 66.4
long-context-understanding-on-mrcr-v2-128kGemma 4 12B Unified#4Accuracy: 43.4
multi-task-language-understanding-on-mmmluGemma 4 31B#2Accuracy: 88.4
multi-task-language-understanding-on-mmmluGemma 4 12B Unified#9Accuracy: 83.4
multimodal-reasoning-on-mathvisionGemma 4 31B#6Accuracy: 85.6
multimodal-reasoning-on-mathvisionGemma 4 26B-A4B#9Accuracy: 82.4
multimodal-reasoning-on-mathvisionGemma 4 12B Unified#10Accuracy: 79.7
multimodal-reasoning-on-mmmu-proGemma 4 31B#8Accuracy: 76.9
multimodal-reasoning-on-mmmu-proGemma 4 26B-A4B#15Accuracy: 73.8
multimodal-reasoning-on-mmmu-proGemma 4 12B Unified#21Accuracy: 69.1
agents-on-benchGemma 4 31B#15Accuracy: 76.9
agents-on-benchGemma 4 12B Unified#21Accuracy: 69.0
multi-task-language-understanding-on-mmlu-proGemma 4 31B#15Accuracy: 85.2
multi-task-language-understanding-on-mmlu-proGemma 4 26B-A4B#31Accuracy: 82.6
multi-task-language-understanding-on-mmlu-proGemma 4 12B Unified#52Accuracy: 77.2
multi-task-language-understanding-on-mmlu-proGemma 4 E4B#75Accuracy: 69.4
multi-task-language-understanding-on-mmlu-proGemma 4 E2B#96Accuracy: 60.0
code-generation-on-livecodebench-v6Gemma 4 31B#20Pass@1: 80.0
code-generation-on-livecodebench-v6Gemma 4 12B Unified#31Pass@1: 72.0
mathematical-reasoning-on-aime-2026Gemma 4 31B#21Accuracy: 89.2
mathematical-reasoning-on-aime-2026Gemma 4 12B Unified#31Accuracy: 77.5
multiple-choice-question-answering-mcqa-on-gpqa-diamondGemma 4 31B#40Accuracy: 84.3
multiple-choice-question-answering-mcqa-on-gpqa-diamondGemma 4 26B-A4B#49Accuracy: 82.3
multiple-choice-question-answering-mcqa-on-gpqa-diamondGemma 4 12B Unified#58Accuracy: 78.8
multiple-choice-question-answering-mcqa-on-gpqa-diamondGemma 4 E4B#98Accuracy: 58.6
question-answering-on-humanity-s-last-exam-hleGemma 4 26B-A4B#41Accuracy: 8.7
question-answering-on-humanity-s-last-exam-hleGemma 4 12B Unified#42Accuracy: 5.2