mlsanityData to 7 Oct 2026

Unsupervised Multi-Granularity Summarization

arXiv 2201.12502 ↗First posted 29 Jan 2022cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Text summarization is a user-preference based task, i.e., for one document, users often have different priorities for summary. As a key aspect of customization in summarization, granularity is used to measure the semantic coverage between the summary and source document. However, developing systems that can generate summaries with customizable semantic coverage is still an under-explored topic. In this paper, we propose the first unsupervised multi-granularity summarization framework, GranuSum. We take events as the basic semantic units of the source documents and propose to rank these events by their salience. We also develop a model to summarize input documents with given events as anchors and hints. By inputting different numbers of events, GranuSum is capable of producing multi-granular summaries in an unsupervised manner. Meanwhile, we annotate a new benchmark GranuDUC that contains multiple summaries at different granularities for each document cluster. Experimental results confirm the substantial superiority of GranuSum on multi-granularity summarization over strong baselines. Further, by exploiting the event information, GranuSum also exhibits state-of-the-art performance under the conventional unsupervised abstractive setting. Dataset for this paper can be found at: https://github.com/maszhongming/GranuDUC

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 31 of its 57 references that are in the map. First posted on arXiv 29 Jan 2022.

Builds on

31 of 57 references.

References · 31

  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2020Longformer: The Long-Document Transformercited by 3,362
  4. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  5. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  6. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  7. 2019Text Summarization with Pretrained Encoderscited by 553
  8. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  9. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  10. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  11. 2020Extractive Summarization as Text Matchingcited by 189
  12. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
19 more
  1. 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
  2. 2017Controllable Abstractive Summarizationcited by 110
  3. 2020CTRLsum: Towards Generic Controllable Text Summarizationcited by 98
  4. 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 90
  5. 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
  6. 2016Controlling Output Length in Neural Encoder-Decoderscited by 75
  7. 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 64
  8. 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
  9. 2020WikiAsp: A Dataset for Multi-domain Aspect-based Summarizationcited by 56
  10. 2019Searching for Effective Neural Extractive Summarization: What Works and What's Nextcited by 38
  11. 2020TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoisingcited by 30
  12. 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
  13. 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
  14. 2019A Closer Look at Data Bias in Neural Extractive Summarization Modelscited by 18
  15. 2020CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systemscited by 17
  16. 2020Unsupervised Extractive Summarization by Pre-training Hierarchical Transformerscited by 16
  17. 2019Exploring Domain Shift in Extractive Text Summarizationcited by 15
  18. 2018Learning to Encode Text as Human-Readable Summaries using Generative Adversarial Networkscited by 11
  19. 2021Fine-Grained Opinion Summarization with Minimal Supervisioncited by 1

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 3.

5 papers.