Beyond Layer-Wise Merging: Chain-of-Merging for Vision-Language Models

Benchmark Model Rank Results
mathematical-reasoning-on-mathverseCoM (Qwen2.5-VL-7B + Qwen2.5-Math-7B)–Accuracy: 50.25
multimodal-reasoning-on-mathvisionCoM (Qwen2.5-VL-72B + Qwen2.5-Math-72B)–Accuracy: 40.95
multimodal-reasoning-on-mathvistaCoM (Qwen2.5-VL-72B + Qwen2.5-Math-72B)–Accuracy: 75.9
vision-language-understanding-on-mmstarCoM (Qwen2.5-VL-7B + DeepSeek-R1-Distill-Qwen-7B)–Accuracy: 65.0