mlsanityData to 7 Oct 2026

Hierarchical Indexing for Retrieval-Augmented Opinion Summarization

arXiv 2403.00435 ↗First posted 1 Mar 2024cs.CLcited by 7

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

We propose a method for unsupervised abstractive opinion summarization, that combines the attributability and scalability of extractive approaches with the coherence and fluency of Large Language Models (LLMs). Our method, HIRO, learns an index structure that maps sentences to a path through a semantically organized discrete hierarchy. At inference time, we populate the index and use it to identify and retrieve clusters of sentences containing popular opinions from input reviews. Then, we use a pretrained LLM to generate a readable summary that is grounded in these extracted evidential clusters. The modularity of our approach allows us to evaluate its efficacy at each stage. We show that HIRO learns an encoding space that is more semantically structured than prior work, and generates summaries that are more representative of the opinions in the input reviews. Human evaluation confirms that HIRO generates significantly more coherent, detailed and accurate summaries.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 50 of its 70 references that are in the map. First posted on arXiv 1 Mar 2024.

Builds on

50 of 70 references.

References · 50

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  8. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  10. 2020Longformer: The Long-Document Transformercited by 3,362
  11. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  12. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
38 more
  1. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  2. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  3. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  4. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  5. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  6. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  7. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
  8. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  9. 2021Measuring Attribution in Natural Language Generation Modelscited by 253
  10. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
  11. 2020Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillationcited by 143
  12. 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
  13. 2023Retrieval meets Long Context Large Language Modelscited by 114
  14. 2015Order-Embeddings of Images and Languagecited by 112
  15. 2018Data-to-Text Generation with Content Selection and Planningcited by 106
  16. 2023Human Feedback is not Gold Standardcited by 82
  17. 2023Learning to Filter Context for Retrieval-Augmented Generationcited by 82
  18. 2020Extractive Opinion Summarization in Quantized Transformer Spacescited by 76
  19. 2019Unsupervised Opinion Summarization as Copycat-Review Generationcited by 68
  20. 2018Content Selection in Deep Learning Models of Summarizationcited by 64
  21. 2022Generating Data to Mitigate Spurious Correlations in Natural Language Inference Datasetscited by 54
  22. 2021Aspect-Controllable Opinion Summarizationcited by 47
  23. 2022Conditional Generation with a Question-Answering Blueprintcited by 44
  24. 2022Prompted Opinion Summarization with GPT-3.5cited by 44
  25. 2022mFACE: Multilingual Summarization with Factual Consistency Evaluationcited by 42
  26. 2023SEAHORSE: A Multilingual, Multifaceted Dataset for Summarization Evaluationcited by 42
  27. 2020Unsupervised Opinion Summarization with Content Planningcited by 27
  28. 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
  29. 2024Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Taskscited by 23
  30. 2021Convex Aggregation for Opinion Summarizationcited by 21
  31. 2022Unsupervised Extractive Opinion Summarization Using Sparse Codingcited by 17
  32. 2023Constructing Tree-based Index for Efficient and Effective Dense Retrievalcited by 15
  33. 2023OpinSummEval: Revisiting Automated Evaluation for Opinion Summarizationcited by 13
  34. 2023From Key Points to Key Point Hierarchy: Structured and Expressive Opinion Summarizationcited by 8
  35. 2023Attributable and Scalable Opinion Summarizationcited by 6
  36. 2022OpineSum: Entailment-based self-training for abstractive opinion summarizationcited by 3
  37. 2023StrAE: Autoencoding for Pre-Trained Embeddings using Explicit Structurecited by 2
  38. 2023Automatically Evaluating Opinion Prevalence in Opinion Summarizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Temporal Knowledge-Base Creation for Fine-Grained Opinion Analysis with Language Models
  2. 2026ThreadSumm: Summarization of Nested Discourse Threads Using Tree of Thoughts
  3. 2024Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs
  4. 2023Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization
  5. 2023Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method
  6. 2025Beyond Perplexity: Let the Reader Select Retrieval Summaries via Spectrum Projection Score
  7. 2025Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages
  8. 2024Learning to Summarize from LLM-generated Feedback