Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception

Benchmark Model Rank Results
zero-shot-action-recognition-on-hmdb51IMP-MoE-LTop-1 Accuracy: 59.1
zero-shot-action-recognition-on-kineticsIMP-MoE-LTop-1 Accuracy: 76.8
zero-shot-action-recognition-on-ucf101IMP-MoE-LTop-1 Accuracy: 91.5
zero-shot-transfer-image-classification-on-1IMP-MoE-LAccuracy (Private): 83.9