Introducing OpenAI o3 and o4-mini

Benchmark Model Rank Results
code-generation-on-aider-polyglotOpenAI o3 (High)#1Accuracy: 81.3
agents-on-taubench-airlineOpenAI o3#2Accuracy: 52.0
agents-on-taubench-retailOpenAI o3#2Accuracy: 70.4
multimodal-reasoning-on-mmmuOpenAI o3#4Accuracy: 82.9
mathematical-reasoning-on-aime24OpenAI o4-mini#5Acc: 93.4
chart-question-answering-on-charxiv-rqOpenAI o3#6Accuracy: 78.6
multimodal-reasoning-on-mathvistaOpenAI o3#6Accuracy: 86.8
instruction-following-on-multichallengeOpenAI o3#8Accuracy: 56.51
mathematical-reasoning-on-aime-2025OpenAI o4-mini#16Accuracy: 92.7
question-answering-on-humanity-s-last-exam-hleOpenAI o3#28Accuracy: 20.32
deep-research-agents-on-browsecompOpenAI o4-mini (w/ Python)#42Accuracy: 51.5
multiple-choice-question-answering-mcqa-on-gpqa-diamondOpenAI o3#47Accuracy: 83.3
code-generation-on-humanevalo4 Mini High–Pass@1: 96.3