Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs

Benchmark Model Rank Results
sentiment-analysis-on-imdbSpace-XLNet#19Accuracy: 94.88
text-classification-on-hatexplain-1Space-XLNet#1Accuracy (2 classes): 0.8798F1 Macro: 0.8797
text-classification-on-hatexplain-1XLNet#2Accuracy (2 classes): 0.8160F1 Macro: 0.8156
text-classification-on-hatexplain-1Space-BERT#3Accuracy (2 classes): 0.8110F1 Macro: 0.8108
text-classification-on-hatexplain-1BERT-base#4Accuracy (2 classes): 0.6588F1 Macro: 0.6555
text-classification-on-imdb-movie-reviews-1XLNet#2Accuracy (2 classes): 0.9387
text-classification-on-imdb-movie-reviews-1Space-XLNet#3F1 Macro: 0.9487