Hierarchical Indexing for Retrieval-Augmented Opinion Summarization
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
We propose a method for unsupervised abstractive opinion summarization, that combines the attributability and scalability of extractive approaches with the coherence and fluency of Large Language Models (LLMs). Our method, HIRO, learns an index structure that maps sentences to a path through a semantically organized discrete hierarchy. At inference time, we populate the index and use it to identify and retrieve clusters of sentences containing popular opinions from input reviews. Then, we use a pretrained LLM to generate a readable summary that is grounded in these extracted evidential clusters. The modularity of our approach allows us to evaluate its efficacy at each stage. We show that HIRO learns an encoding space that is more semantically structured than prior work, and generates summaries that are more representative of the opinions in the input reviews. Human evaluation confirms that HIRO generates significantly more coherent, detailed and accurate summaries.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 50 of its 70 references that are in the map. First posted on arXiv 1 Mar 2024.
Builds on
50 of 70 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
38 more
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
- 2021Measuring Attribution in Natural Language Generation Modelscited by 253
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 143
- 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
- 2023Retrieval meets Long Context Large Language Modelscited by 114
- 2015Order-Embeddings of Images and Languagecited by 112
- 2018Data-to-Text Generation with Content Selection and Planningcited by 106
- 2023Human Feedback is not Gold Standardcited by 82
- 2023Learning to Filter Context for Retrieval-Augmented Generationcited by 82
- 2020Extractive Opinion Summarization in Quantized Transformer Spacescited by 76
- 2019Unsupervised Opinion Summarization as Copycat-Review Generationcited by 68
- 2018Content Selection in Deep Learning Models of Summarizationcited by 64
- 2022Generating Data to Mitigate Spurious Correlations in Natural Language Inference Datasetscited by 54
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2022Conditional Generation with a Question-Answering Blueprintcited by 44
- 2022Prompted Opinion Summarization with GPT-3.5cited by 44
- 2022mFACE: Multilingual Summarization with Factual Consistency Evaluationcited by 42
- 2023SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluationcited by 42
- 2020Unsupervised Opinion Summarization with Content Planningcited by 27
- 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
- 2024Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Taskscited by 23
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2022Unsupervised Extractive Opinion Summarization Using Sparse Codingcited by 17
- 2023Constructing Tree-based Index for Efficient and Effective Dense Retrievalcited by 15
- 2023OpinSummEval: Revisiting Automated Evaluation for Opinion Summarizationcited by 13
- 2023From Key Points to Key Point Hierarchy: Structured and Expressive Opinion Summarizationcited by 8
- 2023Attributable and Scalable Opinion Summarizationcited by 6
- 2022OpineSum: Entailment-based self-training for abstractive opinion summarizationcited by 3
- 2023StrAE: Autoencoding for Pre-Trained Embeddings using Explicit Structurecited by 2
- 2023Automatically Evaluating Opinion Prevalence in Opinion Summarizationcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 2.
7 papers.
- 2025Decomposed Opinion Summarization with Verified Aspect-Aware Modulescited by 3
- 2025OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviewscited by 3
- 2025When LLMs Team Up: The Emergence of Collaborative Affective Computingcited by 2
- 2024LFOSum: Summarizing Long-form Opinions with Large Language Modelscited by 1
- 2025Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systemscited by 1
- 2026DiSCo: Making Absence Visible in Intelligent Summarization Interfacescited by 0
- 2026MOSAIC: Modular Opinion Summarization using Aspect Identification and Clusteringcited by 0
- 2026MOSAIC: Modular Opinion Summarization using Aspect Identification and Clustering1 Mar 2026
- 2026DiSCo: Making Absence Visible in Intelligent Summarization Interfaces12 Jan 2026
- 2025OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviews30 Aug 2025
- 2025Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systems4 Jun 2025
- 2025When LLMs Team Up: The Emergence of Collaborative Affective Computing2 Jun 2025
- 2025Decomposed Opinion Summarization with Verified Aspect-Aware Modules27 Jan 2025
- 2024LFOSum: Summarizing Long-form Opinions with Large Language Models16 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2025Towards Temporal Knowledge-Base Creation for Fine-Grained Opinion Analysis with Language Models
- 2026ThreadSumm: Summarization of Nested Discourse Threads Using Tree of Thoughts
- 2024Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs
- 2023Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization
- 2023Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method
- 2025Beyond Perplexity: Let the Reader Select Retrieval Summaries via Spectrum Projection Score
- 2025Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages
- 2024Learning to Summarize from LLM-generated Feedback