Investigating Efficiently Extending Transformers for Long Input Summarization

Benchmark Model Rank Results
text-summarization-on-pubmedPEGASUS-X#2ROUGE-1: 51.0ROUGE-2: 24.7ROUGE-L: 46.6
text-summarization-on-arxivPegasus-X#3ROUGE-1: 50.0ROUGE-2: 21.8ROUGE-L: 44.6
long-range-modeling-on-scrollsPEGASUS-X#10GovRep: 60.3 / 30.0 / 31.5SumScr: 35.7 / 9.1 / 20.6…
long-range-modeling-on-scrollsPEGASUS-X-Base#11GovRep: 59.3 / 29.3 / 30.9SumScr: 35.0 / 8.9 / 20.4…