GPT-4o mini: advancing cost-efficient intelligence

Benchmark Model Rank Results
math-word-problem-solving-on-mgsm-0-shotGPT-4o mini#3Accuracy: 87.0
math-word-problem-solving-on-mathGPT-4o mini#34Accuracy: 70.2
multimodal-reasoning-on-mmmuGPT-4o mini#60Accuracy: 59.4
code-generation-on-humanevalGPT-4o mini–Pass@1: 87.2