| Long Document Summarization with Top-down and Bottom-up Inference | ✓ Link | 50.95 | 21.93 | 45.61 | Top Down Transformer (AdaPool) (464M) | 2022-03-15 |
| Adapting Pretrained Text-to-Text Models for Long Text Sequences | ✓ Link | 50.2 | | | BART-LS | 2022-09-21 |
| Investigating Efficiently Extending Transformers for Long Input Summarization | ✓ Link | 50.0 | 21.8 | 44.6 | Pegasus-X | 2022-08-08 |
| Document Summarization with Text Segmentation | | 49.49 | 21.04 | 44.34 | ExtSum + oracle segmentation (extractive) | 2023-01-20 |
| Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents | ✓ Link | 49.32 | 20.27 | 44.76 | FactorSum | 2022-05-25 |
| Document Summarization with Text Segmentation | | 49.11 | 20.68 | 44.01 | ExtSum + supervised segmentation (extractive) | 2023-01-20 |
| Toward Unifying Text Segmentation and Long Document Summarization | ✓ Link | 48.45 | 20.72 | 42.55 | Lodoss-full-large (extractive) | 2022-10-28 |
| MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes | ✓ Link | 48.42 | 20.30 | 42.54 | MemSum (extractive) | 2021-07-19 |
| LongT5: Efficient Text-To-Text Transformer for Long Sequences | ✓ Link | 48.35 | 21.92 | 44.27 | LongT5 | 2021-12-15 |
| Toward Unifying Text Segmentation and Long Document Summarization | ✓ Link | 48.20 | 20.50 | 42.28 | Lodoss-full-base (extractive) | 2022-10-28 |
| Sparsifying Transformer Models with Trainable Representation Pooling | | 47.15 | 19.99 | | DeepPyramidion | 2021-11-16 |
| Sparsifying Transformer Models with Trainable Representation Pooling | | 46.85 | 19.39 | | Blockwise(baseline) | 2021-11-16 |
| Hierarchical Learning for Generation with Long Source Sequences | | 46.74 | 19.19 | 42.2 | HAT-BART | 2021-04-15 |
| HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information | | 45.22 | 17.67 | 40.16 | HiStruct+ | 2022-03-17 |
| A Divide-and-Conquer Approach to the Summarization of Long Documents | ✓ Link | 45.01 | 17.6 | 40.56 | DANCER PEGASUS | 2020-04-13 |
| PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization | ✓ Link | 44.67 | | | PEGASUS | 2019-12-18 |
| Systematically Exploring Redundancy Reduction in Summarizing Long Documents | ✓ Link | 44.01 | 17.79 | 39.09 | ExtSum-LG+RdLoss | 2020-11-30 |
| Systematically Exploring Redundancy Reduction in Summarizing Long Documents | ✓ Link | 43.87 | 17.5 | 38.97 | ExtSum-LG+MMR-Select+ | 2020-11-30 |
| Extractive Summarization of Long Documents by Combining Global and Local Context | ✓ Link | 43.58 | 17.37 | | ExtSum-LG | 2019-09-17 |
| Segmented Recurrent Transformer: An Efficient Sequence-to-Sequence Model | ✓ Link | 42.99 | | | SRformer-BART | 2023-05-24 |
| A Divide-and-Conquer Approach to the Summarization of Long Documents | ✓ Link | 42.7 | 16.54 | 38.44 | DANCER RUM | 2020-04-13 |
| On Extractive and Abstractive Neural Document Summarization with Transformer Language Models | ✓ Link | 42.43 | | | TLM-I+E | 2019-09-07 |
| On Extractive and Abstractive Neural Document Summarization with Transformer Language Models | ✓ Link | 42.32 | | | Sent-PTR | 2019-09-07 |
| A Divide-and-Conquer Approach to the Summarization of Long Documents | ✓ Link | 41.87 | 15.92 | 37.61 | DANCER LSTM | 2020-04-13 |
| GenCompareSum: a hybrid unsupervised summarization method using salience | ✓ Link | 39.96 | 15.15 | 36.19 | GenCompareSum | |
| A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents | ✓ Link | 35.80 | | | Discourse | 2018-04-16 |
| On Extractive and Abstractive Neural Document Summarization with Transformer Language Models | ✓ Link | 34.01 | | | Sent-CLF | 2019-09-07 |
| Get To The Point: Summarization with Pointer-Generator Networks | ✓ Link | 32.06 | | | Pntr-Gen-Seq2Seq | 2017-04-14 |