Extractive Opinion Summarization in Quantized Transformer Spaces
Not on the map. Why?
Abstract (arXiv)
We present the Quantized Transformer (QT), an unsupervised system for extractive opinion summarization. QT is inspired by Vector-Quantized Variational Autoencoders, which we repurpose for popularity-driven summarization. It uses a clustering interpretation of the quantized space and a novel extraction algorithm to discover popular opinions among hundreds of reviews, a significant step towards opinion summarization of practical scope. In addition, QT enables controllable summarization without further training, by utilizing properties of the quantized space to extract aspect-specific summaries. We also make publicly available SPACE, a large-scale evaluation benchmark for opinion summarizers, comprising general and aspect-specific summaries for 50 hotels. Experiments demonstrate the promise of our approach, which is validated by human studies where judges showed clear preference for our method over competitive baselines.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 14; 2023: 19; 2024: 21; 2025: 9; 2026: 4.
76 papers.
Sort:
By area:
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 848
- 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
- 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
- 2023ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understandingcited by 175
- 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasingcited by 22
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2021Convex Aggregation for Opinion Summarizationcited by 21
38 more
- 2021Comparative Opinion Summarization via Collaborative Decodingcited by 18
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
- 2022Unsupervised Extractive Opinion Summarization Using Sparse Codingcited by 17
- 2022Efficient Few-Shot Fine-Tuning for Opinion Summarizationcited by 16
- 2021StreamHover: Livestream Transcript Summarization and Annotationcited by 15
- 2023OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarizationcited by 15
- 2021Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidancecited by 14
- 2023Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluationcited by 14
- 2023Do Multi-Document Summarization Models Synthesize?cited by 11
- 2025A Survey on Transformer Context Extension: Approaches and Evaluationcited by 11
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Followingcited by 10
- 2022Beyond Opinion Mining: Summarizing Opinions of Customer Reviewscited by 9
- 2022Template-based Abstractive Microblog Opinion Summarisationcited by 9
- 2024An Empirical Analysis of Diversity in Argument Summarizationcited by 9
- 2025Lost in Transmission: When and Why LLMs Fail to Reason Globallycited by 9
- 2023From Key Points to Key Point Hierarchy: Structured and Expressive Opinion Summarizationcited by 8
- 2024SEAM: A Stochastic Benchmark for Multi-Document Taskscited by 8
- 2022Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understandingcited by 7
- 2023Concise Answers to Complex Questions: Summarization of Long-form Answerscited by 7
- 2024Hierarchical Indexing for Retrieval-Augmented Opinion Summarizationcited by 7
- 2023Attributable and Scalable Opinion Summarizationcited by 6
- 2023"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledgecited by 6
- 2023Zebra: Extending Context Window with Layerwise Grouped Local-Global Attentioncited by 6
- 2024Product Description and QA Assisted Self-Supervised Opinion Summarizationcited by 6
- 2024Instance-Aware Graph Prompt Learningcited by 6
- 2022Multi-Document Summarization with Centroid-Based Pretrainingcited by 5
- 2022Unsupervised Opinion Summarization Using Approximate Geodesicscited by 5
- 2022Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Postscited by 5
- 2024Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Textscited by 5
- 2024Incremental Extractive Opinion Summarization Using Cover Treescited by 4
- 2024STRUM-LLM: Attributed and Structured Contrastive Summarizationcited by 4
- 2022Survey of Aspect-based Sentiment Analysis Datasetscited by 3
- 2022OpineSum: Entailment-based self-training for abstractive opinion summarizationcited by 3
- 2023Domain-Expanded ASTE: Rethinking Generalization in Aspect Sentiment Triplet Extractioncited by 3
- 2024Rationale-based Opinion Summarizationcited by 3
- 2024MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarizationcited by 3
- 2024Retrieval Or Holistic Understanding? Dolce: Differentiate Our Long Context Evaluation Taskscited by 3
- 2025Decomposed Opinion Summarization with Verified Aspect-Aware Modulescited by 3
50 most cited of 76 All 76 (JSON)
- 2026When Evidence Conflicts: Reliability-aware Meta-review Generation21 Sep 2026
- 2026Scoring Rules! Statistical and Strategic Alignment for Text Evaluation Metrics2 Aug 2026
- 2026MOSAIC: Modular Opinion Summarization using Aspect Identification and Clustering1 Mar 2026
- 2026DiSCo: Making Absence Visible in Intelligent Summarization Interfaces12 Jan 2026
- 2025OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviews30 Aug 2025
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Novelty20 Aug 2025
- 2025LLMs as Architects and Critics for Multi-Source Opinion Summarization7 Jul 2025
- 2025Aspect-Based Opinion Summarization with Argumentation Schemes11 Jun 2025
- 2025A Scalable Unsupervised Framework for multi-aspect labeling of Multilingual and Multi-Domain Review Data14 May 2025
- 2025Lost in Transmission: When and Why LLMs Fail to Reason Globally13 May 2025
- 2025A Survey on Transformer Context Extension: Approaches and Evaluation17 Mar 2025
- 2025Q-STRUM Debate: Query-Driven Contrastive Summarization for Recommendation Comparison18 Feb 2025
38 more
- 2025Decomposed Opinion Summarization with Verified Aspect-Aware Modules27 Jan 2025
- 2024A Survey on Large Language Model Acceleration based on KV Cache Management27 Dec 2024
- 2024Instance-Aware Graph Prompt Learning26 Nov 2024
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Following30 Oct 2024
- 2024LFOSum: Summarizing Long-form Opinions with Large Language Models16 Oct 2024
- 2024ACCEPT: Adaptive Codebook for Composite and Efficient Prompt Tuning10 Oct 2024
- 2024Retrieval Or Holistic Understanding? Dolce: Differentiate Our Long Context Evaluation Tasks10 Sep 2024
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP29 Jun 2024
- 2024SEAM: A Stochastic Benchmark for Multi-Document Tasks23 Jun 2024
- 2024AspirinSum: an Aspect-based utility-preserved de-identification Summarization framework20 Jun 2024
- 2024Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMM16 Jun 2024
- 2024MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarization5 Jun 2024
- 2024SnapKV: LLM Knows What You are Looking for Before Generation22 Apr 2024
- 2024Product Description and QA Assisted Self-Supervised Opinion Summarization8 Apr 2024
- 2024Polarity Calibration for Opinion Summarization2 Apr 2024
- 2024Rationale-based Opinion Summarization30 Mar 2024
- 2024ReflectSumm: A Benchmark for Course Reflection Summarization27 Mar 2024
- 2024STRUM-LLM: Attributed and Structured Contrastive Summarization25 Mar 2024
- 2024Hierarchical Indexing for Retrieval-Augmented Opinion Summarization1 Mar 2024
- 2024Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Texts16 Feb 2024
- 2024An Empirical Analysis of Diversity in Argument Summarization2 Feb 2024
- 2024Incremental Extractive Opinion Summarization Using Cover Trees16 Jan 2024
- 2023Zebra: Extending Context Window with Layerwise Grouped Local-Global Attention14 Dec 2023
- 2023OpenAsp: A Benchmark for Multi-document Open Aspect-based Summarization7 Dec 2023
- 2023Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning29 Nov 2023
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Survey15 Nov 2023
- 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?8 Nov 2023
- 2023Automatically Evaluating Opinion Prevalence in Opinion Summarization26 Jul 2023
- 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Models20 Jul 2023
- 2023From Key Points to Key Point Hierarchy: Structured and Expressive Opinion Summarization6 Jun 2023
- 2023Concise Answers to Complex Questions: Summarization of Long-form Answers30 May 2023
- 2023AaKOS: Aspect-adaptive Knowledge-based Opinion Summarization26 May 2023
- 2023Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation24 May 2023
- 2023Domain-Expanded ASTE: Rethinking Generalization in Aspect Sentiment Triplet Extraction23 May 2023
- 2023ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding23 May 2023
- 2023"What do others think?": Task-Oriented Conversational Modeling with Subjective Knowledge20 May 2023
- 2023Attributable and Scalable Opinion Summarization19 May 2023
- 2023Recent Trends in Unsupervised Summarization18 May 2023
50 newest of 76 All 76 (JSON)
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 848
- 2024SnapKV: LLM Knows What You are Looking for Before Generation22 Apr 2024
- 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
- 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
- 2023ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understandingcited by 175
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasingcited by 22
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2021Comparative Opinion Summarization via Collaborative Decodingcited by 18
- 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
12 most cited of 71 All 71 (JSON)
- 2026When Evidence Conflicts: Reliability-aware Meta-review Generation21 Sep 2026
- 2026Scoring Rules! Statistical and Strategic Alignment for Text Evaluation Metrics2 Aug 2026
- 2026MOSAIC: Modular Opinion Summarization using Aspect Identification and Clustering1 Mar 2026
- 2026DiSCo: Making Absence Visible in Intelligent Summarization Interfaces12 Jan 2026
- 2025OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviews30 Aug 2025
- 2025The Variance Paradox: How AI Reduces Diversity but Increases Novelty20 Aug 2025
- 2025LLMs as Architects and Critics for Multi-Source Opinion Summarization7 Jul 2025
- 2025Aspect-Based Opinion Summarization with Argumentation Schemes11 Jun 2025
- 2025A Scalable Unsupervised Framework for multi-aspect labeling of Multilingual and Multi-Domain Review Data14 May 2025
- 2025A Survey on Transformer Context Extension: Approaches and Evaluation17 Mar 2025
- 2025Q-STRUM Debate: Query-Driven Contrastive Summarization for Recommendation Comparison18 Feb 2025
- 2025Decomposed Opinion Summarization with Verified Aspect-Aware Modules27 Jan 2025
12 newest of 71 All 71 (JSON)