Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets

Benchmark Model Rank Results
text-classification-on-r8DeBERTa#1Accuracy: 98.451
text-classification-on-r8C-BERT (ESGNN + BERT)#2Accuracy: 98.28
text-classification-on-r8ESGNN#3Accuracy: 98.23
text-classification-on-r8BERT#5Accuracy: 98.171
text-classification-on-r8SGNN#6Accuracy: 98.09
text-classification-on-r8ERNIE 2.0#7Accuracy: 98.041
text-classification-on-r8DistilBERT#8Accuracy: 97.981
text-classification-on-r8ALBERTv2#10Accuracy: 97.62
text-classification-on-r8WideMLP#18Accuracy: 96.98
text-classification-on-r8fastText#20Accuracy: 96.13
text-classification-on-twitterERNIE 2.0#1Accuracy: 99.97
text-classification-on-twitterBERT#2Accuracy: 99.96
text-classification-on-twitterDistilBERT#3Accuracy: 99.96
text-classification-on-mrDeBERTa#2Accuracy: 90.21
text-classification-on-mrERNIE 2.0 (optimized)#4Accuracy: 89.53
text-classification-on-mrRoBERTa#5Accuracy: 89.42
text-classification-on-mrERNIE 2.0#6Accuracy: 88.97
text-classification-on-mrBERT#7Accuracy: 86.94
text-classification-on-mrALBERTv2#8Accuracy: 86.02
text-classification-on-mrDistilBERT#9Accuracy: 85.31