# Massive Multi-Document Summarization of Product Reviews with Weak Supervision

arXiv: https://arxiv.org/abs/2007.11348 · HTML: https://mlsanity.com/paper/2007.11348/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Jul 2020.

## Built on by (most cited first, 7 of 7)

- [OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization](https://mlsanity.com/paper/2312.04440/) (2023)
- [Large-Scale and Multi-Perspective Opinion Summarization with Diverse Review Subsets](https://mlsanity.com/paper/2310.13340/) (2023)
- [Identifying Helpful Sentences in Product Reviews](https://mlsanity.com/paper/2104.09792/) (2021)
- [Beyond Opinion Mining: Summarizing Opinions of Customer Reviews](https://mlsanity.com/paper/2206.01543/) (2022)
- [Multi-Perspective Abstractive Answer Summarization](https://mlsanity.com/paper/2104.08536/) (2021)
- [Multi-Review Fusion-in-Context](https://mlsanity.com/paper/2403.15351/) (2024)
- [MARS: Multilingual Aspect-centric Review Summarisation](https://mlsanity.com/paper/2410.09991/) (2024)

## Abstract (arXiv)

Product reviews summarization is a type of Multi-Document Summarization (MDS) task in which the summarized document sets are often far larger than in traditional MDS (up to tens of thousands of reviews). We highlight this difference and coin the term "Massive Multi-Document Summarization" (MMDS) to denote an MDS task that involves hundreds of documents or more. Prior work on product reviews summarization considered small samples of the reviews, mainly due to the difficulty of handling massive document sets. We show that summarizing small samples can result in loss of important information and provide misleading evaluation results. We propose a schema for summarizing a massive set of reviews on top of a standard summarization algorithm. Since writing large volumes of reference summaries needed for advanced neural network models is impractical, our solution relies on weak supervision. Finally, we propose an evaluation scheme that is based on multiple crowdsourced reference summaries and aims to capture the massive review collection. We show that an initial implementation of our schema significantly improves over several baselines in ROUGE scores, and exhibits strong coherence in a manual linguistic quality assessment.
