LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model

Benchmark Model Rank Results
visual-question-answering-vqa-on-core-mmLLaMA-Adapter V2#6Overall score: 30.46Deductive: 28.7Abductive: 46.12…
video-based-generative-performance-benchmarking-temporal-understanding-on-videoinstructLLaMA Adapter#15gpt-score: 1.98
video-based-generative-performance-benchmarking-consistency-on-videoinstructLLaMA Adapter#17gpt-score: 2.15
video-based-generative-performance-benchmarking-contextual-understanding-on-videoinstructLLaMA Adapter#17gpt-score: 2.30
video-based-generative-performance-benchmarking-correctness-of-information-on-videoinstructLLaMA Adapter#17gpt-score: 2.03
video-based-generative-performance-benchmarking-detail-orientation-on-videoinstructLLaMA Adapter#17gpt-score: 2.32
video-based-generative-performance-benchmarking-on-videoinstructLLaMA Adapter#22mean: 2.16Correctness of Information: 2.03Detail Orientation: 2.32…
video-question-answering-on-activitynet-qaLLaMA Adapter V2#26Accuracy: 34.2Confidence score: 2.7
zeroshot-video-question-answer-on-activitynet-qaLLaMA Adapter#26Accuracy: 34.2Confidence Score: 2.7
zeroshot-video-question-answer-on-msvd-qaLLaMA Adapter-7B#27Accuracy: 54.9Confidence Score: 3.1
zeroshot-video-question-answer-on-msrvtt-qaLLaMA Adapter-7B#29Accuracy: 43.8Confidence Score: 2.7
visual-question-answering-on-mm-vetLLaMA-Adapter v2-7B#172GPT-4 score: 31.4±0.1Params: 7B