GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

Benchmark Model Rank Results
visual-question-answering-vqa-on-realworldqaGeMoE (extra data)#84Accuracy: 60.1
visual-question-answering-on-mm-vetGeMoE (extra data)#86GPT-4 score: 44.1
vision-language-understanding-on-mmstarGeMoE (extra data)#97Accuracy: 41.1