LongT5: Efficient Text-To-Text Transformer for Long Sequences

Benchmark Model Rank Results
abstractive-text-summarization-on-cnn-dailyLongT5#20ROUGE-1: 43.94ROUGE-2: 21.40ROUGE-L: 41.28
long-range-modeling-on-scrollsLongT5 XL#1Avg.: 42.53GovRep: 61.1 / 32.3 / 33.7SumScr: 35.8 / 9.6 / 21.1
long-range-modeling-on-scrollsLongT5 Large#2Avg.: 41.03GovRep: 61.3/32.2/33.8SumScr: 60.3 / 31.1 / 32.8
long-range-modeling-on-scrollsLongT5 Base#4Avg.: 38.6GovRep: 57.7 / 30.0 / 31.4SumScr: 34.8 / 9.6 / 21.1
multi-document-summarization-on-multi-newsLongT5#2ROUGE-1: 48.17ROUGE-2: 19.43ROUGE-SU4: 24.94
text-summarization-on-arxivLongT5#7ROUGE-1: 48.35ROUGE-2: 21.92ROUGE-L: 44.27
text-summarization-on-pubmed-1LongT5#3ROUGE-1: 50.23ROUGE-2: 24.76ROUGE-L: 46.67