mlsanityData to 7 Oct 2026

Large-Scale and Multi-Perspective Opinion Summarization with Diverse Review Subsets

arXiv 2310.13340 ↗First posted 20 Oct 2023cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Opinion summarization is expected to digest larger review sets and provide summaries from different perspectives. However, most existing solutions are deficient in epitomizing extensive reviews and offering opinion summaries from various angles due to the lack of designs for information selection. To this end, we propose SUBSUMM, a supervised summarization framework for large-scale multi-perspective opinion summarization. SUBSUMM consists of a review sampling strategy set and a two-stage training scheme. The sampling strategies take sentiment orientation and contrastive information value into consideration, with which the review subsets from different perspectives and quality levels can be selected. Subsequently, the summarizer is encouraged to learn from the sub-optimal and optimal subsets successively in order to capitalize on the massive input. Experimental results on AmaSum and Rotten Tomatoes datasets demonstrate that SUBSUMM is adept at generating pros, cons, and verdict summaries from hundreds of input reviews. Furthermore, our in-depth analysis verifies that the advanced selection of review subsets and the two-stage training scheme are vital to boosting the summarization performance.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 20 Oct 2023.

Builds on

36 of 52 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  8. 2020Longformer: The Long-Document Transformercited by 3,362
  9. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  10. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  11. 2019Text Summarization with Pretrained Encoderscited by 553
  12. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
24 more
  1. 2016Using the Output Embedding to Improve Language Modelscited by 266
  2. 2020Extractive Summarization as Text Matchingcited by 189
  3. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
  4. 2017Learning to Generate Reviews and Discovering Sentimentcited by 147
  5. 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 131
  6. 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
  7. 2021CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarizationcited by 120
  8. 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
  9. 2017Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotationcited by 77
  10. 2019Unsupervised Opinion Summarization as Copycat-Review Generationcited by 68
  11. 2017Classical Structured Prediction Losses for Sequence to Sequence Learningcited by 55
  12. 2016Neural Network-Based Abstract Generation for Opinions and Argumentscited by 46
  13. 2022Prompted Opinion Summarization with GPT-3.5cited by 44
  14. 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
  15. 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
  16. 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
  17. 2021Sequence Level Contrastive Learning for Text Summarizationcited by 31
  18. 2020Unsupervised Opinion Summarization with Content Planningcited by 27
  19. 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
  20. 2021Self-Supervised Multimodal Opinion Summarizationcited by 18
  21. 2022Efficient Few-Shot Fine-Tuning for Opinion Summarizationcited by 16
  22. 2021Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidancecited by 14
  23. 2021Alleviating Exposure Bias via Contrastive Learning for Abstractive Text Summarizationcited by 14
  24. 2020Massive Multi-Document Summarization of Product Reviews with Weak Supervisioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 5.

10 papers.