Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities

Benchmark Model Rank Results
code-generation-on-livecodebench-v5Gemini 2.5 Flash–Pass@1: 59.3
code-generation-on-livecodebench-v5Gemini 2.5 Pro–Pass@1: 74.2
code-generation-on-swe-bench-verifiedGemini 2.5 Flash (single attempt)–Accuracy: 48.9
code-generation-on-swe-bench-verifiedGemini 2.5 Pro (single attempt)–Accuracy: 59.6
long-context-understanding-on-mrcr-v2-128kGemini 2.5 Flash–Accuracy: 54.3
long-context-understanding-on-mrcr-v2-128kGemini 2.5 Pro–Accuracy: 58.0
long-context-understanding-on-mrcr-v2-1mGemini 2.5 Flash–Accuracy: 21.0
long-context-understanding-on-mrcr-v2-1mGemini 2.5 Pro–Accuracy: 16.4
mathematical-reasoning-on-aime-2025Gemini 2.5 Flash–Accuracy: 72.0
mathematical-reasoning-on-aime-2025Gemini 2.5 Pro–Accuracy: 88.0
multimodal-reasoning-on-mmmuGemini 2.5 Flash–Accuracy: 79.7
multimodal-reasoning-on-mmmuGemini 2.5 Pro–Accuracy: 82.0
multimodal-reasoning-on-zerobenchGemini 2.5 Flash–Accuracy: 2.0
multimodal-reasoning-on-zerobenchGemini 2.5 Pro–Accuracy: 4.5
multiple-choice-question-answering-mcqa-on-gpqa-diamondGemini 2.5 Flash–Accuracy: 82.8
multiple-choice-question-answering-mcqa-on-gpqa-diamondGemini 2.5 Pro–Accuracy: 86.4
question-answering-on-humanity-s-last-exam-hleGemini 2.5 Flash–Accuracy: 11.0
question-answering-on-humanity-s-last-exam-hleGemini 2.5 Pro–Accuracy: 21.6
question-answering-on-simpleqaGemini 2.5 Flash–Accuracy: 26.9
question-answering-on-simpleqaGemini 2.5 Pro–Accuracy: 54.0
video-question-answering-on-lvbenchGemini 2.5 Flash–Accuracy: 62.7
video-question-answering-on-lvbenchGemini 2.5 Pro–Accuracy: 78.7
visual-question-answering-vqa-on-vibe-evalGemini 2.5 Flash–Accuracy: 65.4
visual-question-answering-vqa-on-vibe-evalGemini 2.5 Pro–Accuracy: 67.2