| 3d-question-answering-3d-qa-on-scanqa-test-w | VideoChat2 | #11 | Exact Match: 19.2BLEU-4: 9.6ROUGE: 28.2METEOR: 9.5CIDEr: 49.2 |
| 3d-question-answering-3d-qa-on-sqa3d | VideoChat2 | #7 | Exact Match: 37.3 |
| vcgbench-diverse-on-videoinstruct | VideoChat2 | #3 | mean: 2.20Correctness of Information: 2.13Detail Orientation: 2.42… |
| video-based-generative-performance | VideoChat2_HD_mistral | #10 | mean: 3.10Correctness of Information: 3.40Detail Orientation: 2.91… |
| video-based-generative-performance | VideoChat2 | #15 | mean: 2.98Correctness of Information: 3.02Detail Orientation: 2.88… |
| video-based-generative-performance-1 | VideoChat2_HD_mistral | #5 | gpt-score: 3.40 |
| video-based-generative-performance-1 | VideoChat2 | #9 | gpt-score: 3.02 |
| video-based-generative-performance-2 | VideoChat2 | #7 | gpt-score: 2.81 |
| video-based-generative-performance-2 | VideoChat2_HD_mistral | #10 | gpt-score: 2.62 |
| video-based-generative-performance-3 | VideoChat2_HD_mistral | #7 | gpt-score: 3.64 |
| video-based-generative-performance-3 | VideoChat2 | #9 | gpt-score: 3.51 |
| video-based-generative-performance-4 | VideoChat2 | #11 | gpt-score: 2.88 |
| video-based-generative-performance-4 | VideoChat2_HD_mistral | #12 | gpt-score: 2.86 |
| video-based-generative-performance-5 | VideoChat2 | #7 | gpt-score: 2.66 |
| video-based-generative-performance-5 | VideoChat2_HD_mistral | #8 | gpt-score: 2.65 |
| video-question-answering-on-activitynet-qa | VideoChat2 | #4 | Accuracy: 49.1Confidence score: 3.3 |
| video-question-answering-on-intentqa | VideoChat2_HD_mistral | #1 | Accuarcy: 83.4CW: 84.0CH: 90.0TP&TN: 77.3 |
| video-question-answering-on-intentqa | VideoChat2_mistral | #2 | Accuarcy: 81.9CW: 82.6CH: 86.9TP&TN: 77.0 |
| video-question-answering-on-mvbench | VideoChat2 | #13 | Avg.: 51.9 |
| video-question-answering-on-next-qa | VideoChat2_HD_mistral | #13 | Accuracy: 79.5 |
| video-question-answering-on-next-qa | VideoChat2_mistral | #16 | Accuracy: 78.6 |
| video-question-answering-on-next-qa | VideoChat2 | #28 | Accuracy: 68.6 |
| video-question-answering-on-tvbench | VideoChat2 | #21 | Average Accuracy: 35.0 |
| zero-shot-video-question-answer-on-egoschema | VideoChat2_HD_mistral | #6 | Accuracy: 65.6 |
| zero-shot-video-question-answer-on-egoschema | VideoChat2_mistral | #7 | Accuracy: 63.6 |
| zero-shot-video-question-answer-on-egoschema-1 | VideoChat2_phi3 | #12 | Accuracy: 56.7 |
| zero-shot-video-question-answer-on-egoschema-1 | VideoChat2_HD_mistral | #13 | Accuracy: 55.8 |
| zero-shot-video-question-answer-on-egoschema-1 | VideoChat2_mistral | #14 | Accuracy: 54.4 |
| zero-shot-video-question-answer-on-next-qa | VideoChat2 | #17 | Accuracy: 61.7 |
| zero-shot-video-question-answer-on-star | VideoChat2 | #1 | Accuracy: 59.0 |
| zero-shot-video-question-answer-on-tvqa | VideoChat_HD_mistral (no speech) | #4 | Accuracy: 50.6 |
| zero-shot-video-question-answer-on-tvqa | VideoChat_mistral (no speech) | #5 | Accuracy: 46.4 |
| zero-shot-video-question-answer-on-tvqa | VideoChat2 (no speech) | #6 | Accuracy: 40.6 |
| zeroshot-video-question-answer-on-activitynet | VideoChat2 | #14 | Accuracy: 49.1Confidence Score: 3.3 |
| zeroshot-video-question-answer-on-msrvtt-qa | VideoChat2 | #22 | Accuracy: 54.1Confidence Score: 3.3 |
| zeroshot-video-question-answer-on-msvd-qa | VideoChat2 | #18 | Accuracy: 70.0Confidence Score: 3.9 |