mlsanityData to 14 Oct 2026

Aspect-Based Summarization with Self-Aspect Retrieval Enhanced Generation

arXiv 2504.13054 ↗First posted 17 Apr 2025cs.CL cs.AIcited by 3

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

Aspect-based summarization aims to generate summaries tailored to specific aspects, addressing the resource constraints and limited generalizability of traditional summarization approaches. Recently, large language models have shown promise in this task without the need for training. However, they rely excessively on prompt engineering and face token limits and hallucination challenges, especially with in-context learning. To address these challenges, in this paper, we propose a novel framework for aspect-based summarization: Self-Aspect Retrieval Enhanced Summary Generation. Rather than relying solely on in-context learning, given an aspect, we employ an embedding-driven retrieval mechanism to identify its relevant text segments. This approach extracts the pertinent content while avoiding unnecessary details, thereby mitigating the challenge of token limits. Moreover, our framework optimizes token usage by deleting unrelated parts of the text and ensuring that the model generates output strictly based on the given aspect. With extensive experiments on benchmark datasets, we demonstrate that our framework not only achieves superior performance but also effectively mitigates the token limitation problem.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 49 references that are in the map. First posted on arXiv 17 Apr 2025.

Builds on

28 of 49 references.

References · 28

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2020Longformer: The Long-Document Transformercited by 3,413
  4. 2024Mixtral of Expertscited by 1,823
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  6. 2022A Survey on In-context Learningcited by 721
  7. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
  8. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  9. 2023Benchmarking Large Language Models for News Summarizationcited by 445
  10. 2024∞Bench: Extending Long Context Evaluation Beyond 100K Tokenscited by 367
  11. 2023LongLoRA: Efficient Fine-tuning of Long-Context Large Language Modelscited by 244
  12. 2020Extractive Summarization as Text Matchingcited by 189
16 more
  1. 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 189
  2. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  3. 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
  4. 2023To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisiscited by 92
  5. 2023Multi-Dimensional Evaluation of Text Summarization with In-Context Learningcited by 44
  6. 2024AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledgecited by 44
  7. 2022Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learningcited by 38
  8. 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
  9. 2023On Context Utilization in Summarization with Large Language Modelscited by 30
  10. 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
  11. 2024A Survey on Neural Topic Models: Methods, Applications, and Challengescited by 18
  12. 2025Can Textual Gradient Work in Federated Learning?cited by 15
  13. 2024Are LLMs Good Zero-Shot Fallacy Classifiers?cited by 12
  14. 2024LLaMandement: Large Language Models for Summarization of French Legislative Proposalscited by 9
  15. 2024LexAbSumm: Aspect-based Summarization of Legal Decisionscited by 9
  16. 2023USB: A Unified Summarization Benchmark Across Tasks and Domainscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs
  2. 2025Estimating Optimal Context Length for Hybrid Retrieval-augmented Multi-document Summarization
  3. 2023Context-aware Decoding Reduces Hallucination in Query-focused Summarization
  4. 2025FG-RAG: Enhancing Query-Focused Summarization with Context-Aware Fine-Grained Graph RAG
  5. 2024Towards a Robust Retrieval-Based Summarization System
  6. 2025Beyond Perplexity: Let the Reader Select Retrieval Summaries via Spectrum Projection Score
  7. 2026SVD-RAG: Efficient Tree-Organized Retrieval-Augmented Generation via Singular Value Decomposition
  8. 2024IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization