Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation

Benchmark Model Rank Results
object-hallucination-evaluation-on-popeTRAG (Qwen2.5-1.5B)#18F1: 87.2
visual-question-answering-vqa-on-mmbench-cnTRAG (Qwen2.5-1.5B)#20Accuracy: 69.3
visual-question-answering-vqa-on-mmbench-enTRAG (Qwen2.5-1.5B)#31Accuracy: 70.8
multimodal-reasoning-on-mmmuTRAG (Qwen2.5-1.5B)#127Accuracy: 38.7