MiniMax-01: Scaling Foundation Models with Lightning Attention

Benchmark Model Rank Results
chart-question-answering-on-chartqaMiniMax-VL-01#31:1 Accuracy: 91.7
question-answering-on-c-simpleqaMiniMax-Text-01#3Accuracy: 67.4
visual-question-answering-on-docvqa-testMiniMax-VL-01#4ANLS: 0.964
question-answering-on-simpleqaMiniMax-Text-01#7Accuracy: 23.7
long-context-understanding-on-longbench-v2MiniMax-Text-01#11Accuracy: 56.5
math-word-problem-solving-on-mathMiniMax-Text-01#21Accuracy: 77.4
optical-character-recognition-ocr-on-ocrbenchMiniMax-VL-01#23Score: 865
arithmetic-reasoning-on-gsm8kMiniMax-Text-01#26Accuracy: 94.8
multimodal-reasoning-on-mmmuMiniMax-VL-01#38Accuracy: 68.5
multimodal-reasoning-on-mmmu-proMiniMax-VL-01#39Accuracy: 52.7
code-generation-on-humanevalMiniMax-Text-01#40Pass@1: 86.9
multi-task-language-understanding-on-mmlu-proMiniMax-Text-01#55Accuracy: 75.7
multimodal-reasoning-on-mathvistaMiniMax-VL-01#68Accuracy: 68.6
multiple-choice-question-answering-mcqa-on-gpqa-diamondMiniMax-Text-01#107Accuracy: 54.4