`Keep it Together': Enforcing Cohesion in Extractive Summaries by Simulating Human Memory
Not on the map. Why?
Abstract (arXiv)
Extractive summaries are usually presented as lists of sentences with no expected cohesion between them. In this paper, we aim to enforce cohesion whilst controlling for informativeness and redundancy in summaries, in cases where the input exhibits high redundancy. The pipeline controls for redundancy in long inputs as it is consumed, and balances informativeness and cohesion during sentence selection. Our sentence selector simulates human memory to keep track of topics --modeled as lexical chains--, enforcing cohesive ties between noun phrases. Across a variety of domains, our experiments revealed that it is possible to extract highly cohesive summaries that nevertheless read as informative to humans as summaries extracted by only accounting for informativeness or redundancy. The extracted summaries exhibit smooth topic transitions between sentences as signaled by lexical chains, with chains spanning adjacent or near-adjacent sentences.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 51 references that are in the map. First posted on arXiv 16 Feb 2024.
Builds on
22 of 51 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2015Teaching Machines to Read and Comprehendcited by 1,039
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
10 more
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 333
- 2019BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarizationcited by 155
- 2020Felix: Flexible Text Editing Through Tagging and Insertioncited by 58
- 2019BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principlecited by 39
- 2022DiscoScore: Evaluating Text Generation with BERT and Discourse Coherencecited by 35
- 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
- 2020Systematically Exploring Redundancy Reduction in Summarizing Long Documentscited by 21
- 2022How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluationcited by 4
Built on by
Not cited yet.