VisionZip: Longer is Better but Not Necessary in Vision Language Models

Benchmark Model Rank Results
visual-question-answering-on-mm-vetVisionZip (Retain 128 Tokens, fine-tuning)#154GPT-4 score: 32.9
visual-question-answering-on-mm-vetVisionZip (Retain 192 Tokens, fine-tuning)#157GPT-4 score: 32.6
visual-question-answering-on-mm-vetVisionZip (Retain 128 Tokens)#158GPT-4 score: 32.6
visual-question-answering-on-mm-vetVisionZip (Retain 192 Tokens)#169GPT-4 score: 31.7
visual-question-answering-on-mm-vetVisionZip (Retain 64 Tokens)#170GPT-4 score: 31.7
visual-question-answering-on-mm-vetVisionZip (Retain 64 Tokens, fine-tuning)#181GPT-4 score: 30.2