Aspect-Based Summarization with Self-Aspect Retrieval Enhanced Generation
On the map: Retrieval-augmented generation → RAG pipeline design and evaluation
Abstract (arXiv)
Aspect-based summarization aims to generate summaries tailored to specific aspects, addressing the resource constraints and limited generalizability of traditional summarization approaches. Recently, large language models have shown promise in this task without the need for training. However, they rely excessively on prompt engineering and face token limits and hallucination challenges, especially with in-context learning. To address these challenges, in this paper, we propose a novel framework for aspect-based summarization: Self-Aspect Retrieval Enhanced Summary Generation. Rather than relying solely on in-context learning, given an aspect, we employ an embedding-driven retrieval mechanism to identify its relevant text segments. This approach extracts the pertinent content while avoiding unnecessary details, thereby mitigating the challenge of token limits. Moreover, our framework optimizes token usage by deleting unrelated parts of the text and ensuring that the model generates output strictly based on the given aspect. With extensive experiments on benchmark datasets, we demonstrate that our framework not only achieves superior performance but also effectively mitigates the token limitation problem.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 28 of its 49 references that are in the map. First posted on arXiv 17 Apr 2025.
Builds on
28 of 49 references.
References · 28
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2024Mixtral of Expertscited by 1,823
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2022A Survey on In-context Learningcited by 721
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 656
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2023Benchmarking Large Language Models for News Summarizationcited by 445
- 2024∞Bench: Extending Long Context Evaluation Beyond 100K Tokenscited by 367
- 2023LongLoRA: Efficient Fine-tuning of Long-Context Large Language Modelscited by 244
- 2020Extractive Summarization as Text Matchingcited by 189
16 more
- 2023Compressing Context to Enhance Inference Efficiency of Large Language Modelscited by 189
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
- 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
- 2023To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisiscited by 92
- 2023Multi-Dimensional Evaluation of Text Summarization with In-Context Learningcited by 44
- 2024AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledgecited by 44
- 2022Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learningcited by 38
- 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
- 2024A Survey on Neural Topic Models: Methods, Applications, and Challengescited by 18
- 2025Can Textual Gradient Work in Federated Learning?cited by 15
- 2024Are LLMs Good Zero-Shot Fallacy Classifiers?cited by 12
- 2024LLaMandement: Large Language Models for Summarization of French Legislative Proposalscited by 9
- 2024LexAbSumm: Aspect-based Summarization of Legal Decisionscited by 9
- 2023USB: A Unified Summarization Benchmark Across Tasks and Domainscited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025CARPAS: Towards Content-Aware Refinement of Provided Aspects for Summarization in Large Language Modelscited by 0
- 2026OrchMAS: Orchestrated Reasoning with Multi Collaborative Heterogeneous Scientific Expert Structured Agentscited by 0
- 2026DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Modelscited by 0
- 2026DTScribe: Generating Models for Digital Twin Reporting using Local Large Language Models13 Oct 2026
- 2026OrchMAS: Orchestrated Reasoning with Multi Collaborative Heterogeneous Scientific Expert Structured Agents3 Mar 2026
- 2025CARPAS: Towards Content-Aware Refinement of Provided Aspects for Summarization in Large Language Models8 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2024Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs
- 2025Estimating Optimal Context Length for Hybrid Retrieval-augmented Multi-document Summarization
- 2023Context-aware Decoding Reduces Hallucination in Query-focused Summarization
- 2025FG-RAG: Enhancing Query-Focused Summarization with Context-Aware Fine-Grained Graph RAG
- 2024Towards a Robust Retrieval-Based Summarization System
- 2025Beyond Perplexity: Let the Reader Select Retrieval Summaries via Spectrum Projection Score
- 2026SVD-RAG: Efficient Tree-Organized Retrieval-Augmented Generation via Singular Value Decomposition
- 2024IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization