MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset

Benchmark Model Rank Results
node-classification-on-mumin-largeHeteroGraphSAGE#1Claim Classification Macro-F1: 0.5980…
node-classification-on-mumin-largeLaBSE#2Claim Classification Macro-F1: 0.5790…
node-classification-on-mumin-largeMajority class#3Claim Classification Macro-F1: 0.4813…
node-classification-on-mumin-largeRandom#4Claim Classification Macro-F1: 0.3879…
node-classification-on-mumin-mediumHeteroGraphSAGE#1Claim Classification Macro-F1: 0.5770…
node-classification-on-mumin-mediumLaBSE#2Claim Classification Macro-F1: 0.5585…
node-classification-on-mumin-mediumMajority class#3Claim Classification Macro-F1: 0.4806…
node-classification-on-mumin-mediumRandom#4Claim Classification Macro-F1: 0.3896…
node-classification-on-mumin-smallLaBSE#1Claim Classification Macro-F1: 0.6255…
node-classification-on-mumin-smallHeteroGraphSAGE#2Claim Classification Macro-F1: 0.5795…
node-classification-on-mumin-smallMajority class#3Claim Classification Macro-F1: 0.4756…
node-classification-on-mumin-smallRandom#4Claim Classification Macro-F1: 0.4007…