mlsanityData to 14 Oct 2026

A Condense-then-Select Strategy for Text Summarization

arXiv 2106.10468 ↗First posted 19 Jun 2021cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Select-then-compress is a popular hybrid, framework for text summarization due to its high efficiency. This framework first selects salient sentences and then independently condenses each of the selected sentences into a concise version. However, compressing sentences separately ignores the context information of the document, and is therefore prone to delete salient information. To address this limitation, we propose a novel condense-then-select framework for text summarization. Our framework first concurrently condenses each document sentence. Original document sentences and their compressed versions then become the candidates for extraction. Finally, an extractor utilizes the context information of the document to select candidates and assembles them into a summary. If salient information is deleted during condensing, the extractor can select an original sentence to retain the information. Thus, our framework helps to avoid the loss of salient information, while preserving the high efficiency of sentence-level compression. Experiment results on the CNN/DailyMail, DUC-2002, and Pubmed datasets demonstrate that our framework outperforms the select-then-compress framework and other strong baselines.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 19 Jun 2021.

Builds on

43 of 55 references.

References · 43

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  7. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
  8. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  9. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  10. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  11. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  12. 2015Teaching Machines to Read and Comprehendcited by 1,049
31 more
  1. 2015Pointer Networkscited by 895
  2. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
  3. 2019Text Summarization with Pretrained Encoderscited by 556
  4. 2016Self-critical Sequence Training for Image Captioningcited by 547
  5. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
  6. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
  7. 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 246
  8. 2020UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Trainingcited by 204
  9. 2020Extractive Summarization as Text Matchingcited by 189
  10. 2018Bottom-Up Abstractive Summarizationcited by 177
  11. 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
  12. 2018Ranking Sentences for Extractive Summarization with Reinforcement Learningcited by 128
  13. 2016Neural Summarization by Extracting Sentences and Wordscited by 116
  14. 2017Controllable Abstractive Summarizationcited by 110
  15. 2019On Extractive and Abstractive Neural Document Summarization with Transformer Language Modelscited by 83
  16. 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
  17. 2018Learning to Extract Coherent Summary via Deep Reinforcement Learningcited by 64
  18. 2019Extractive Summarization of Long Documents by Combining Global and Local Contextcited by 59
  19. 2016A Simple, Fast Diverse Decoding Algorithm for Neural Generationcited by 58
  20. 2018Neural Document Summarization by Jointly Learning to Score and Select Sentencescited by 56
  21. 2018Deep Communicating Agents for Abstractive Summarizationcited by 50
  22. 2018A Unified Model for Extractive and Abstractive Summarization using Inconsistency Losscited by 47
  23. 2018BanditSum: Extractive Summarization as a Contextual Banditcited by 46
  24. 2019Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewardscited by 41
  25. 2020Exclusive Hierarchical Decoding for Deep Keyphrase Generationcited by 38
  26. 2019Neural Extractive Text Summarization with Syntactic Compressioncited by 37
  27. 2019An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extractioncited by 28
  28. 2019An Entity-Driven Framework for Abstractive Summarizationcited by 25
  29. 2018Iterative Document Representation Learning Towards Summarization with Polishingcited by 12
  30. 2020A Unified Dual-view Model for Review Summarization and Sentiment Classification with Inconsistency Losscited by 10
  31. 2016Classify or Select: Neural Architectures for Extractive Document Summarizationcited by 9

Built on by

Cited by year

Citing papers per year: 2021: 1.

1 paper.