Unsupervised Multi-Granularity Summarization
Not on the map. Why?
Abstract (arXiv)
Text summarization is a user-preference based task, i.e., for one document, users often have different priorities for summary. As a key aspect of customization in summarization, granularity is used to measure the semantic coverage between the summary and source document. However, developing systems that can generate summaries with customizable semantic coverage is still an under-explored topic. In this paper, we propose the first unsupervised multi-granularity summarization framework, GranuSum. We take events as the basic semantic units of the source documents and propose to rank these events by their salience. We also develop a model to summarize input documents with given events as anchors and hints. By inputting different numbers of events, GranuSum is capable of producing multi-granular summaries in an unsupervised manner. Meanwhile, we annotate a new benchmark GranuDUC that contains multiple summaries at different granularities for each document cluster. Experimental results confirm the substantial superiority of GranuSum on multi-granularity summarization over strong baselines. Further, by exploiting the event information, GranuSum also exhibits state-of-the-art performance under the conventional unsupervised abstractive setting. Dataset for this paper can be found at: https://github.com/maszhongming/GranuDUC
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 31 of its 57 references that are in the map. First posted on arXiv 29 Jan 2022.
Builds on
31 of 57 references.
References · 31
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
- 2020Extractive Summarization as Text Matchingcited by 189
- 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
19 more
- 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
- 2017Controllable Abstractive Summarizationcited by 110
- 2020CTRLsum: Towards Generic Controllable Text Summarizationcited by 98
- 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 90
- 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
- 2016Controlling Output Length in Neural Encoder-Decoderscited by 75
- 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 64
- 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
- 2020WikiAsp: A Dataset for Multi-domain Aspect-based Summarizationcited by 56
- 2019Searching for Effective Neural Extractive Summarization: What Works and What's Nextcited by 38
- 2020TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoisingcited by 30
- 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2019A Closer Look at Data Bias in Neural Extractive Summarization Modelscited by 18
- 2020CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systemscited by 17
- 2020Unsupervised Extractive Summarization by Pre-training Hierarchical Transformerscited by 16
- 2019Exploring Domain Shift in Extractive Text Summarizationcited by 15
- 2018Learning to Encode Text as Human-Readable Summaries using Generative Adversarial Networkscited by 11
- 2021Fine-Grained Opinion Summarization with Minimal Supervisioncited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 3.
5 papers.
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2023Summarization is (Almost) Deadcited by 43
- 2024EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphscited by 9
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interactioncited by 5
- 2024Query-Guided Self-Supervised Summarization of Nursing Notescited by 0
- 2024Query-Guided Self-Supervised Summarization of Nursing Notes4 Jul 2024
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models17 Jun 2024
- 2024EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs30 Mar 2024
- 2023Summarization is (Almost) Dead18 Sep 2023
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interaction16 Jun 2023