Attributable and Scalable Opinion Summarization
Not on the map. Why?
Abstract (arXiv)
We propose a method for unsupervised opinion summarization that encodes sentences from customer reviews into a hierarchical discrete latent space, then identifies common opinions based on the frequency of their encodings. We are able to generate both abstractive summaries by decoding these frequent encodings, and extractive summaries by selecting the sentences assigned to the same frequent encodings. Our method is attributable, because the model identifies sentences used to generate the summary as part of the summarization process. It scales easily to many hundreds of input reviews, because aggregation is performed in the latent space rather than over long sequences of tokens. We also demonstrate that our appraoch enables a degree of control, generating aspect-specific summaries by restricting the model to parts of the encoding space that correspond to desired aspects (e.g., location or food). Automatic and human evaluation on two datasets from different domains demonstrates that our method generates summaries that are more informative than prior work and better grounded in the input reviews.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 19 May 2023.
Builds on
33 of 50 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
21 more
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 225
- 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 112
- 2020Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summarycited by 88
- 2021Improving Question Answering Model Robustness with Synthetic Adversarial Data Generationcited by 79
- 2017Data Noising as Smoothing in Neural Network Language Modelscited by 78
- 2020Extractive Opinion Summarization in Quantized Transformer Spacescited by 76
- 2019Unsupervised Opinion Summarization as Copycat-Review Generationcited by 68
- 2020Robust Training of Vector Quantized Bottleneck Modelscited by 54
- 2021Learning the Predictability of the Futurecited by 49
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2016Neural Network-Based Abstract Generation for Opinions and Argumentscited by 46
- 2020Unsupervised Opinion Summarization with Content Planningcited by 27
- 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
- 2022Hierarchical Sketch Induction for Paraphrase Generationcited by 22
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2021Comparative Opinion Summarization via Collaborative Decodingcited by 18
- 2022Unsupervised Extractive Opinion Summarization Using Sparse Codingcited by 17
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 0; 2026: 1.
6 papers.
- 2023Human Feedback is not Gold Standardcited by 83
- 2024Hierarchical Indexing for Retrieval-Augmented Opinion Summarizationcited by 7
- 2024Incremental Extractive Opinion Summarization Using Cover Treescited by 4
- 2023Automatically Evaluating Opinion Prevalence in Opinion Summarizationcited by 1
- 2024Query-Guided Self-Supervised Summarization of Nursing Notescited by 0
- 2026CoNewsReader: Supporting Comprehensive Understanding and Raising Critical Thoughts on Social Media News Through Commentscited by 0
- 2026CoNewsReader: Supporting Comprehensive Understanding and Raising Critical Thoughts on Social Media News Through Comments30 Apr 2026
- 2024Query-Guided Self-Supervised Summarization of Nursing Notes4 Jul 2024
- 2024Hierarchical Indexing for Retrieval-Augmented Opinion Summarization1 Mar 2024
- 2024Incremental Extractive Opinion Summarization Using Cover Trees16 Jan 2024
- 2023Human Feedback is not Gold Standard28 Sep 2023
- 2023Automatically Evaluating Opinion Prevalence in Opinion Summarization26 Jul 2023