N24News: A New Dataset for Multimodal News Classification

Benchmark Model Rank Results
news-classification-on-n15newsMultimodal(ViT+BERT, Input: Image + Body)#1Accuracy: 0.9249
news-classification-on-n15newsBERT (Input: Body)#2Accuracy: 0.9203
news-classification-on-n15newsMultimodal(ViT+BERT, Input: Image + Abstract)#3Accuracy: 0.8610
news-classification-on-n15newsBERT (Input: Abstract)#4Accuracy: 0.8471
news-classification-on-n15newsMultimodal(ViT+BERT, Input: Image + Headline) - Dot#5Accuracy: 0.8202
news-classification-on-n15newsMultimodal(ViT+BERT, Input: Image + Caption) - Concatenate#6Accuracy: 0.7951
news-classification-on-n15newsBERT (Input: Caption)#7Accuracy: 0.7792
news-classification-on-n15newsBERT (Input: Headline)#8Accuracy: 0.7727
news-classification-on-n15newsViT (Input: Image)#9Accuracy: 0.6065