MaMMUT: A Simple Architecture for Joint Learning for MultiModal Tasks

Benchmark Model Rank Results
video-captioning-on-msvdMaMMUT#1CIDEr: 195.6
visual-question-answering-on-msrvtt-qaMaMMUT#2Accuracy: 0.495
visual-question-answering-on-msvd-qaMaMMUT (ours)#2Accuracy: .602
image-retrieval-on-flickr30kMaMMUT (ours)#4Recall@10: 98Recall@5: 96Recall@1: 82.5Image-to-text R@1: 94.9…
video-captioning-on-msr-vttMaMMUT (ours)#6CIDEr: 73.6
cross-modal-retrieval-on-coco-2014MaMMUT (ours)#31Image-to-text R@1: 70.7Image-to-text R@5: 89.1…