Learning Consistency in Reward Modeling for Multi-Modal Reasoning

Benchmark Model Rank Results
chart-question-answering-on-charxiv-dqQwen2.5-VL-7B (CRM RL, after RL)–Accuracy: 77.3
mathematical-reasoning-on-mathverseCRM-RL-8B (Ours, soft-reward)–Accuracy: 65.8
multimodal-reasoning-on-mathvisionCRM-RL-8B (Ours, soft-reward)–Accuracy: 57.2
multimodal-reasoning-on-mathvistaCRM-RL-8B (Ours, soft-reward)–Accuracy: 79.2