Analysis of the Evolution of Advanced Transformer-Based Language Models: Experiments on Opinion Mining

Benchmark Model Rank Results
opinion-mining-on-imdb-movie-reviewsELECTRA#1Accuracy: 95.6F1: 95.6
opinion-mining-on-imdb-movie-reviewsRoBERTa#2Accuracy: 95.3F1: 95.3
opinion-mining-on-imdb-movie-reviewsDeBERTa#3Accuracy: 95.1F1: 95.1
opinion-mining-on-imdb-movie-reviewsLongformer#4Accuracy: 95.0
opinion-mining-on-imdb-movie-reviewsXLNet#5Accuracy: 94.8F1: 94.9
opinion-mining-on-imdb-movie-reviewsBART#6Accuracy: 94.6
opinion-mining-on-imdb-movie-reviewsConvBERT#7Accuracy: 94.5F1: 94.6
opinion-mining-on-imdb-movie-reviewsBERT#8Accuracy: 94.0F1: 94.1
opinion-mining-on-imdb-movie-reviewsT5#9Accuracy: 93.9F1: 94.0
opinion-mining-on-imdb-movie-reviewsDistilBERT#10Accuracy: 93.4F1: 93.5
opinion-mining-on-imdb-movie-reviewsALBERT#11Accuracy: 93.0F1: 93.0
opinion-mining-on-imdb-movie-reviewsXLM-RoBERTA#12Accuracy: 75.2F1: 77.0
opinion-mining-on-imdb-movie-reviewsGPT-2#13Accuracy: 54.5F1: 52.9
opinion-mining-on-imdb-movie-reviewsGPT#14Accuracy: 53.2F1: 66.4
opinion-mining-on-imdb-movie-reviewsReformer#15Accuracy: 52.2F1: 53.3