BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning

Benchmark Model Rank Results
vcgbench-diverse-on-videoinstructBT-Adapter#4mean: 2.19Correctness of Information: 2.20Detail Orientation: 2.62
video-based-generative-performanceBT-Adapter#18mean: 2.69Correctness of Information: 2.68Detail Orientation: 2.69
video-based-generative-performanceBT-Adapter (zero-shot)#19mean: 2.46Correctness of Information: 2.16Detail Orientation: 2.46
video-based-generative-performance-1BT-Adapter#13gpt-score: 2.68
video-based-generative-performance-1BT-Adapter (zero-shot)#16gpt-score: 2.16
video-based-generative-performance-2BT-Adapter#12gpt-score: 2.46
video-based-generative-performance-2BT-Adapter (zero-shot)#16gpt-score: 2.2
video-based-generative-performance-3BT-Adapter#12gpt-score: 3.27
video-based-generative-performance-3BT-Adapter (zero-shot)#14gpt-score: 2.89
video-based-generative-performance-4BT-Adapter#13gpt-score: 2.69
video-based-generative-performance-4BT-Adapter (zero-shot)#16gpt-score: 2.46
video-based-generative-performance-5BT-Adapter#12gpt-score: 2.34
video-based-generative-performance-5BT-Adapter (zero-shot)#14gpt-score: 2.13
video-question-answering-on-activitynet-qaBT-Adapter (zero-shot)#10Accuracy: 46.1Confidence score: 3.6
zero-shot-video-retrieval-on-activitynetBT-Adapter#8text-to-video R@1: 37.0text-to-video R@5: 66.7
zero-shot-video-retrieval-on-didemoBT-Adapter#12text-to-video R@1: 35.6text-to-video R@5: 61.9
zero-shot-video-retrieval-on-lsmdcBT-Adapter#6text-to-video R@1: 19.5text-to-video R@5: 35.9
zero-shot-video-retrieval-on-msr-vttBT-Adapter#13text-to-video R@1: 40.9text-to-video R@5: 64.7
zeroshot-video-question-answer-on-activitynetBT-Adapter (zero-shot)#19Accuracy: 46.1Confidence Score: 3.2
zeroshot-video-question-answer-on-msrvtt-qaBT-Adapter (zero-shot)#24Accuracy: 51.2Confidence Score: 2.9
zeroshot-video-question-answer-on-msrvtt-qaBT-Adapter (zero-shot)#25Accuracy: 51.2Confidence Score: 2.9
zeroshot-video-question-answer-on-msvd-qaBT-Adapter (zero-shot)#22Accuracy: 67.0Confidence Score: 3.6
zeroshot-video-question-answer-on-msvd-qaBT-Adapter (zero-shot)#23Accuracy: 67.0Confidence Score: 3.6