| video-question-answering-on-activitynet-qa | COLT 10x1 | – | Accuracy: 51.2Confidence score: 3.4 |
| video-question-answering-on-activitynet-qa | COLT 5x2 | – | Accuracy: 52.5Confidence score: 3.5 |
| video-question-answering-on-activitynet-qa | COLT joint | – | Accuracy: 54.7Confidence score: 3.8 |
| video-question-answering-on-mvbench | COLT 10x1 | – | Avg.: 50.6 |
| video-question-answering-on-mvbench | COLT 5x2 | – | Avg.: 51.8 |
| video-question-answering-on-mvbench | COLT joint | – | Avg.: 53.4 |
| zeroshot-video-question-answer-on-activitynet-qa | COLT 10x1 | – | Accuracy: 51.2Confidence Score: 3.4 |
| zeroshot-video-question-answer-on-activitynet-qa | COLT 5x2 | – | Accuracy: 52.5Confidence Score: 3.5 |
| zeroshot-video-question-answer-on-activitynet-qa | COLT joint | – | Accuracy: 54.7Confidence Score: 3.8 |
| zeroshot-video-question-answer-on-msrvtt-qa | COLT 10x1 | – | Accuracy: 63.0Confidence Score: 3.4 |
| zeroshot-video-question-answer-on-msrvtt-qa | COLT 5x2 | – | Accuracy: 63.9Confidence Score: 3.5 |
| zeroshot-video-question-answer-on-msrvtt-qa | COLT joint | – | Accuracy: 65.1Confidence Score: 3.6 |
| zeroshot-video-question-answer-on-msvd-qa | COLT 10x1 | – | Accuracy: 74.7Confidence Score: 3.9 |
| zeroshot-video-question-answer-on-msvd-qa | COLT 5x2 | – | Accuracy: 75.5Confidence Score: 3.9 |
| zeroshot-video-question-answer-on-msvd-qa | COLT joint | – | Accuracy: 78.2Confidence Score: 4.2 |