A Condense-then-Select Strategy for Text Summarization
Not on the map. Why?
Abstract (arXiv)
Select-then-compress is a popular hybrid, framework for text summarization due to its high efficiency. This framework first selects salient sentences and then independently condenses each of the selected sentences into a concise version. However, compressing sentences separately ignores the context information of the document, and is therefore prone to delete salient information. To address this limitation, we propose a novel condense-then-select framework for text summarization. Our framework first concurrently condenses each document sentence. Original document sentences and their compressed versions then become the candidates for extraction. Finally, an extractor utilizes the context information of the document to select candidates and assembles them into a summary. If salient information is deleted during condensing, the extractor can select an original sentence to retain the information. Thus, our framework helps to avoid the loss of salient information, while preserving the high efficiency of sentence-level compression. Experiment results on the CNN/DailyMail, DUC-2002, and Pubmed datasets demonstrate that our framework outperforms the select-then-compress framework and other strong baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 19 Jun 2021.
Builds on
43 of 55 references.
References · 43
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2015Teaching Machines to Read and Comprehendcited by 1,049
31 more
- 2015Pointer Networkscited by 895
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
- 2019Text Summarization with Pretrained Encoderscited by 556
- 2016Self-critical Sequence Training for Image Captioningcited by 547
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
- 2020UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Trainingcited by 204
- 2020Extractive Summarization as Text Matchingcited by 189
- 2018Bottom-Up Abstractive Summarizationcited by 177
- 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
- 2018Ranking Sentences for Extractive Summarization with Reinforcement Learningcited by 128
- 2016Neural Summarization by Extracting Sentences and Wordscited by 116
- 2017Controllable Abstractive Summarizationcited by 110
- 2019On Extractive and Abstractive Neural Document Summarization with Transformer Language Modelscited by 83
- 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
- 2018Learning to Extract Coherent Summary via Deep Reinforcement Learningcited by 64
- 2019Extractive Summarization of Long Documents by Combining Global and Local Contextcited by 59
- 2016A Simple, Fast Diverse Decoding Algorithm for Neural Generationcited by 58
- 2018Neural Document Summarization by Jointly Learning to Score and Select Sentencescited by 56
- 2018Deep Communicating Agents for Abstractive Summarizationcited by 50
- 2018A Unified Model for Extractive and Abstractive Summarization using Inconsistency Losscited by 47
- 2018BanditSum: Extractive Summarization as a Contextual Banditcited by 46
- 2019Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewardscited by 41
- 2020Exclusive Hierarchical Decoding for Deep Keyphrase Generationcited by 38
- 2019Neural Extractive Text Summarization with Syntactic Compressioncited by 37
- 2019An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extractioncited by 28
- 2019An Entity-Driven Framework for Abstractive Summarizationcited by 25
- 2018Iterative Document Representation Learning Towards Summarization with Polishingcited by 12
- 2020A Unified Dual-view Model for Review Summarization and Sentiment Classification with Inconsistency Losscited by 10
- 2016Classify or Select: Neural Architectures for Extractive Document Summarizationcited by 9
Built on by
Citing papers per year: 2021: 1.
1 paper.