Contrastive Audio-Visual Masked Autoencoder

Benchmark Model Rank Results
multi-modal-classification-on-vgg-soundCAV-MAE (Audio-Visual)#1Top-1 Accuracy: 65.9
audio-tagging-on-audiosetCAV-MAE (Audio-Visual)#2mean average precision: 0.512
audio-tagging-on-audiosetCAV-MAE (Audio-Only)#13mean average precision: 0.466
sound-prompted-semantic-segmentation-on-ade20kCAVMAE#2mAP: 26.0mIoU: 17.0
speech-prompted-semantic-segmentation-on-ade20kCAVMAE#2mAP: 27.2mIoU: 19.9
audio-classification-on-audiosetCAV-MAE (Audio-Visual)#3Test mAP: 0.512
audio-classification-on-audiosetCAV-MAE (Audio-Only)#30Test mAP: 0.466
audio-classification-on-audiosetCAV-MAE (Visual-Only)#42Test mAP: 0.262
audio-classification-on-vggsoundCAV-MAE (Audio-Visual)#4Top 1 Accuracy: 65.9
audio-classification-on-vggsoundCAV-MAE (Audio-Only)#8Top 1 Accuracy: 59.5