Better Fine-Tuning by Reducing Representational Collapse

Benchmark Model Rank Results
abstractive-text-summarization-on-cnn-dailyBART+R3F#13ROUGE-1: 44.38ROUGE-2: 21.53ROUGE-L: 41.17
text-summarization-on-gigawordBART-RXF#1ROUGE-1: 40.45ROUGE-2: 20.69ROUGE-L: 36.56
text-summarization-on-reddit-tifuBART+R3F#1ROUGE-1: 30.31ROUGE-2: 10.98ROUGE-L: 24.74