Modeling Endorsement for Multi-Document Abstractive Summarization
Not on the map. Why?
Abstract (arXiv)
A crucial difference between single- and multi-document summarization is how salient content manifests itself in the document(s). While such content may appear at the beginning of a single document, essential information is frequently reiterated in a set of documents related to a particular topic, resulting in an endorsement effect that increases information salience. In this paper, we model the cross-document endorsement effect and its utilization in multiple document summarization. Our method generates a synopsis from each document, which serves as an endorser to identify salient content from other documents. Strongly endorsed text segments are used to enrich a neural encoder-decoder model to consolidate them into an abstractive summary. The method has a great potential to learn from fewer examples to identify salient content, which alleviates the need for costly retraining when the set of documents is dynamically adjusted. Through extensive experiments on benchmark multi-document summarization datasets, we demonstrate the effectiveness of our proposed method over strong published baselines. Finally, we shed light on future research directions and discuss broader challenges of this task using a case study.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 31 of its 54 references that are in the map. First posted on arXiv 15 Oct 2021.
Builds on
31 of 54 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 1,003
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
19 more
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
- 2021Efficient Attentions for Long Document Summarizationcited by 345
- 2019Neural Text Summarization: A Critical Evaluationcited by 189
- 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
- 2019Adaptively Sparse Transformerscited by 155
- 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
- 2019HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarizationcited by 121
- 2020A Large-Scale Multi-Document Summarization Dataset from the Wikipedia Current Events Portalcited by 72
- 2018Adapting the Neural Encoder-Decoder Framework from Single to Multi-Document Summarizationcited by 42
- 2020Multi-document Summarization with Maximal Marginal Relevance-guided Reinforcement Learningcited by 28
- 2021The Summary Loop: Learning to Write Abstractive Summaries Without Examplescited by 27
- 2019Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarizationcited by 22
- 2019Countering the Effects of Lead Bias in News Summarization via Multi-Stage Training and Auxiliary Lossescited by 22
- 2019Generating Summaries with Topic Templates and Structured Convolutional Decoderscited by 20
- 2019Multi-Document Summarization with Determinantal Point Processes and Contextualized Representationscited by 16
- 2015Abstractive Multi-Document Summarization via Phrase Selection and Mergingcited by 10
- 2021Demoting the Lead Bias in News Summarization via Alternating Adversarial Learningcited by 10
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attributioncited by 10
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.