mlsanityData to 14 Oct 2026

Product Description and QA Assisted Self-Supervised Opinion Summarization

arXiv 2404.05243 ↗First posted 8 Apr 2024cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

In e-commerce, opinion summarization is the process of summarizing the consensus opinions found in product reviews. However, the potential of additional sources such as product description and question-answers (QA) has been considered less often. Moreover, the absence of any supervised training data makes this task challenging. To address this, we propose a novel synthetic dataset creation (SDC) strategy that leverages information from reviews as well as additional sources for selecting one of the reviews as a pseudo-summary to enable supervised training. Our Multi-Encoder Decoder framework for Opinion Summarization (MEDOS) employs a separate encoder for each source, enabling effective selection of information while generating the summary. For evaluation, due to the unavailability of test sets with additional sources, we extend the Amazon, Oposum+, and Flipkart test sets and leverage ChatGPT to annotate summaries. Experiments across nine test sets demonstrate that the combination of our SDC approach and MEDOS model achieves on average a 14.5% improvement in ROUGE-1 F1 over the SOTA. Moreover, comparative analysis underlines the significance of incorporating additional sources for generating more informative summaries. Human evaluations further indicate that MEDOS scores relatively higher in coherence and fluency with 0.41 and 0.5 (-1 to 1) respectively, compared to existing models. To the best of our knowledge, we are the first to generate opinion summaries leveraging additional sources in a self-supervised setting.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 8 Apr 2024.

Builds on

25 of 44 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  7. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  8. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  9. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
  10. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
  11. 2019Text Summarization with Pretrained Encoderscited by 556
  12. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
13 more
  1. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 396
  2. 2020Extractive Opinion Summarization in Quantized Transformer Spacescited by 76
  3. 2018Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervisedcited by 75
  4. 2019Unsupervised Opinion Summarization as Copycat-Review Generationcited by 68
  5. 2021Aspect-Controllable Opinion Summarizationcited by 47
  6. 2016Neural Network-Based Abstract Generation for Opinions and Argumentscited by 46
  7. 2022Prompted Opinion Summarization with GPT-3.5cited by 44
  8. 2020Unsupervised Opinion Summarization with Noising and Denoisingcited by 37
  9. 2020Unsupervised Opinion Summarization with Content Planningcited by 27
  10. 2020Self-Supervised and Controlled Multi-Document Opinion Summarizationcited by 23
  11. 2021Self-Supervised Multimodal Opinion Summarizationcited by 18
  12. 2019Weakly-Supervised Opinion Summarization by Leveraging External Informationcited by 11
  13. 2023Simple Yet Effective Synthetic Dataset Construction for Unsupervised Opinion Summarizationcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 3.

6 papers.