Decentralized Instruction Tuning: Conflict-Aware Splitting and Weight Merging

Benchmark Model Rank Results
question-answering-on-boolqMERIT (Proposed, 1D split, 2 groups, Qwen2.5-3B)#18Accuracy: 86.3
common-sense-reasoning-on-winograndeMERIT (Proposed, 2D split, 4 groups, Qwen2.5-3B)#74Accuracy: 70.8
sentence-completion-on-hellaswagMERIT (Proposed, 2D split, 4 groups, Qwen2.5-3B)#94Accuracy: 74.7
visual-question-answering-on-mm-vetMERIT (Proposed, 2D split, Scaled base VLM 7B)#105GPT-4 score: 39.1
code-generation-on-humanevalMERIT (Proposed, 2D split, 4 groups, Qwen2.5-3B)#108Pass@1: 41.5
multimodal-reasoning-on-mmmuMERIT (Proposed, 3D split, 8 groups)#118Accuracy: 42.7