Large-Scale and Multi-Perspective Opinion Summarization with Diverse Review Subsets
Not on the map. Why?
Abstract (arXiv)
Opinion summarization is expected to digest larger review sets and provide summaries from different perspectives. However, most existing solutions are deficient in epitomizing extensive reviews and offering opinion summaries from various angles due to the lack of designs for information selection. To this end, we propose SUBSUMM, a supervised summarization framework for large-scale multi-perspective opinion summarization. SUBSUMM consists of a review sampling strategy set and a two-stage training scheme. The sampling strategies take sentiment orientation and contrastive information value into consideration, with which the review subsets from different perspectives and quality levels can be selected. Subsequently, the summarizer is encouraged to learn from the sub-optimal and optimal subsets successively in order to capitalize on the massive input. Experimental results on AmaSum and Rotten Tomatoes datasets demonstrate that SUBSUMM is adept at generating pros, cons, and verdict summaries from hundreds of input reviews. Furthermore, our in-depth analysis verifies that the advanced selection of review subsets and the two-stage training scheme are vital to boosting the summarization performance.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 20 Oct 2023.
Builds on
36 of 52 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
24 more
- 2016Using the Output Embedding to Improve Language Modelscited by 266
- 2020Extractive Summarization as Text Matchingcited by 189
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2017Learning to Generate Reviews and Discovering Sentimentcited by 147
- 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 131
- 2019Bridging the Gap between Training and Inference for Neural Machine Translationcited by 123
- 2021CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarizationcited by 120
- 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
- 2017Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotationcited by 77
- 2019Unsupervised Opinion Summarization as Copycat-Review Generationcited by 68
- 2017Classical Structured Prediction Losses for Sequence to Sequence Learningcited by 55
- 2016Neural Network-Based Abstract Generation for Opinions and Argumentscited by 46
- 2022Prompted Opinion Summarization with GPT-3.5cited by 44
- 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
- 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
- 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
- 2021Sequence Level Contrastive Learning for Text Summarizationcited by 31
- 2020Unsupervised Opinion Summarization with Content Planningcited by 27
- 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
- 2021Self-Supervised Multimodal Opinion Summarizationcited by 18
- 2022Efficient Few-Shot Fine-Tuning for Opinion Summarizationcited by 16
- 2021Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidancecited by 14
- 2021Alleviating Exposure Bias via Contrastive Learning for Abstractive Text Summarizationcited by 14
- 2020Massive Multi-Document Summarization of Product Reviews with Weak Supervisioncited by 7
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 5.
10 papers.
- 2024Incremental Extractive Opinion Summarization Using Cover Treescited by 4
- 2025Conflicts in Texts: Data, Implications and Challengescited by 2
- 2024Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMMcited by 1
- 2026Faithful Summarisation under Disagreement via Belief-Level Aggregationcited by 1
- 2024AspirinSum: an Aspect-based utility-preserved de-identification Summarization frameworkcited by 0
- 2025LLMs as Architects and Critics for Multi-Source Opinion Summarizationcited by 0
- 2026A Diversity Diet for a Healthier Model: A Case Study of French ModernBERTcited by 0
- 2026Large Language Models for Token-Efficient and Semantic-Preserving Opinion Summarizationcited by 0
- 2026AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Neutralisation for LLM-Generated News in Automated Journalismcited by 0
- 2026WARP: Wasserstein-Aligned RAG for Population Opinionscited by 0
- 2026WARP: Wasserstein-Aligned RAG for Population Opinions24 Aug 2026
- 2026AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Neutralisation for LLM-Generated News in Automated Journalism21 Jul 2026
- 2026Large Language Models for Token-Efficient and Semantic-Preserving Opinion Summarization12 Jul 2026
- 2026A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT25 Feb 2026
- 2026Faithful Summarisation under Disagreement via Belief-Level Aggregation8 Jan 2026
- 2025LLMs as Architects and Critics for Multi-Source Opinion Summarization7 Jul 2025
- 2025Conflicts in Texts: Data, Implications and Challenges28 Apr 2025
- 2024AspirinSum: an Aspect-based utility-preserved de-identification Summarization framework20 Jun 2024
- 2024Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMM16 Jun 2024
- 2024Incremental Extractive Opinion Summarization Using Cover Trees16 Jan 2024