MAI-Thinking-1: Building a Hill-Climbing Machine

Benchmark Model Rank Results
code-generation-on-livecodebench-v6MAI-Thinking-1–Pass@1: 87.7
code-generation-on-swe-bench-proMAI-Thinking-1–Resolved: 52.8
code-generation-on-swe-bench-verifiedMAI-Thinking-1–Accuracy: 73.5
instruction-following-on-ifbenchMAI-Thinking-1–Accuracy: 69
instruction-following-on-multichallengeMAI-Thinking-1–Accuracy: 53
long-context-understanding-on-longbench-v2MAI-Thinking-1–Accuracy: 61
mathematical-reasoning-on-aime-2025MAI-Thinking-1–Accuracy: 97.0
mathematical-reasoning-on-aime-2026MAI-Thinking-1–Accuracy: 94.5
mathematical-reasoning-on-hmmt-feb-2026MAI-Thinking-1–Accuracy: 84.9
multi-task-language-understanding-on-mmlu-proMAI-Thinking-1–Accuracy: 85
multiple-choice-question-answering-mcqa-on-gpqa-diamondMAI-Thinking-1–Accuracy: 84.2