ST-LLM: Large Language Models Are Effective Temporal Learners

Benchmark Model Rank Results
video-based-generative-performance-benchmarking-temporal-understanding-on-videoinstructST-LLM#2gpt-score: 2.93
video-based-generative-performance-benchmarking-contextual-understanding-on-videoinstructST-LLM#5gpt-score: 3.74
video-based-generative-performance-benchmarking-detail-orientation-on-videoinstructST-LLM#5gpt-score: 3.05
video-based-generative-performance-benchmarking-correctness-of-information-on-videoinstructST-LLM#7gpt-score: 3.23
video-based-generative-performance-benchmarking-consistency-on-videoinstructST-LLM#8gpt-score: 2.81
video-based-generative-performance-benchmarking-on-videoinstructST-LLM-7B#9mean: 3.15Correctness of Information: 3.23Detail Orientation: 3.05…
zeroshot-video-question-answer-on-activitynet-qaST-LLM#10Accuracy: 50.9Confidence Score: 3.3
zeroshot-video-question-answer-on-msrvtt-qaST-LLM#10Accuracy: 63.2Confidence Score: 3.4
zeroshot-video-question-answer-on-msvd-qaST-LLM#12Accuracy: 74.6Confidence Score: 3.9
video-question-answering-on-tvbenchST-LLM#20Average Accuracy: 35.7
video-question-answering-on-mvbenchST-LLM#78Avg.: 54.9