VTimeLLM: Empower LLM to Grasp Video Moments

Benchmark Model Rank Results
video-based-generative-performance-benchmarking-detail-orientation-on-videoinstructVTimeLLM#4gpt-score: 3.10
vcgbench-diverse-on-videoinstructVTimeLLM#5mean: 2.17Correctness of Information: 2.16Detail Orientation: 2.41…
dense-video-captioning-on-activitynet-captionsVTimeLLM#10CIDEr: 27.6SODA: 5.8
video-based-generative-performance-benchmarking-temporal-understanding-on-videoinstructVTimeLLM#10gpt-score: 2.49
video-based-generative-performance-benchmarking-consistency-on-videoinstructVTimeLLM#11gpt-score: 2.47
video-based-generative-performance-benchmarking-contextual-understanding-on-videoinstructVTimeLLM#11gpt-score: 3.40
video-based-generative-performance-benchmarking-correctness-of-information-on-videoinstructVTimeLLM#11gpt-score: 2.78
video-question-answering-on-ovbenchVTimeLLM (7B)#11AVG: 33.1
temporal-relation-extraction-on-vinogroundVTimeLLM#13Text Score: 19.4Video Score: 27Group Score: 5.2
video-based-generative-performance-benchmarking-on-videoinstructVTimeLLM#17mean: 2.85Correctness of Information: 2.78Detail Orientation: 3.10…