OpenCodePapers
multimodal-sentiment-analysis-on-cmu-mosei-1
Sentiment Analysis
Multimodal Sentiment Analysis
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Show papers without code
Paper
Code
Accuracy
↕
MAE
↕
F1
↕
Acc-5
↕
Acc-7
↕
Corr
↕
ModelName
ReleaseDate
↕
Multi-label Emotion Analysis in Conversation via Multimodal Knowledge Distillation
88.62
89.04
SeMUL-PCD
2023-10-27
Multimodal Multi-loss Fusion Network for Sentiment Analysis
✓ Link
88.22
0.5072
88.04
57.45
54.77
81.42
MMML
2023-08-01
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition
✓ Link
87.50
0.523
87.46
UniMSE
2022-11-21
Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment
✓ Link
87.34
SPECTRA
2023-05-19
A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis
✓ Link
82.48
Transformer-based joint-encoding
2020-06-29
Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition
✓ Link
82.45
Modulated-fusion transformer
2020-10-05
MMLatch: Bottom-up Top-down Fusion for Multimodal Sentiment Analysis
✓ Link
82.4
0.7
MMLatch
2022-01-24
Multilogue-Net: A Context Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation
✓ Link
82.10
0.59
Multilogue-Net
2020-02-19
Gated Mechanism for Attention Based Multimodal Sentiment Analysis
81.14
Proposed: B2 + B4 w/ multimodal fusion
2020-02-21
Unsupervised Multimodal Language Representations using Convolutional Autoencoders
78
CAE-LR
2021-10-06
Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
76.9
0.71
Graph-MFN
2018-07-01
MARLIN: Masked Autoencoder for facial video Representation LearnINg
✓ Link
74.83
MARLIN (ViT-L)
2022-11-12
MARLIN: Masked Autoencoder for facial video Representation LearnINg
✓ Link
73.7
MARLIN (ViT-B)
2022-11-12
MARLIN: Masked Autoencoder for facial video Representation LearnINg
✓ Link
72.69
MARLIN (ViT-S)
2022-11-12
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis
✓ Link
0.526
55.96
54.28
0.779
ALMT
2023-10-09