StrucSum: Graph-Structured Reasoning for Long Document Extractive Summarization with LLMs
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models (LLMs) have shown strong performance in zero-shot summarization, but often struggle to model document structure and identify salient information in long texts. In this work, we introduce StrucSum, a training-free prompting framework that enhances LLM reasoning through sentence-level graph structures. StrucSum injects structural signals into prompts via three targeted strategies: Neighbor-Aware Prompting (NAP) for local context, Centrality-Aware Prompting (CAP) for importance estimation, and Centrality-Guided Masking (CGM) for efficient input reduction. Experiments on ArXiv, PubMed, and Multi-News demonstrate that StrucSum consistently improves both summary quality and factual consistency over unsupervised baselines and vanilla prompting. In particular, on ArXiv, it increases FactCC and SummaC by 19.2% and 8.0% points, demonstrating stronger alignment between summaries and source content. The ablation study shows that the combination of multiple strategies does not yield clear performance gains; therefore, structure-aware prompting with graph-based information represents a promising and underexplored direction for the advancement of zero-shot extractive summarization with LLMs. Our source code is publicly available.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 26 of its 34 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
26 of 34 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
- 2023Benchmarking Large Language Models for News Summarizationcited by 445
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 327
- 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 91
- 2024FineSurE: Fine-grained Summarization Evaluation using LLMscited by 83
14 more
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2020Leveraging Graph to Improve Abstractive Multi-Document Summarizationcited by 67
- 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 65
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 59
- 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarizationcited by 32
- 2022HEGEL: Hypergraph Transformer for Long Document Summarizationcited by 28
- 2024Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Biascited by 28
- 2022HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Informationcited by 26
- 2020Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networkscited by 22
- 2025Discourse-Driven Evaluation: Unveiling Factual Inconsistency in Long Document Summarizationcited by 8
- 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5
- 2024DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarizationcited by 4
- 2025QA-prompting: Improving Summarization with Large Language Models using Question-Answeringcited by 4
- 2025UMB@PerAnsSumm 2025: Enhancing Perspective-Aware Summarization with Prompt Optimization and Supervised Fine-Tuningcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2025Understanding LLM Reasoning for Abstractive Summarizationcited by 12
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Modelscited by 8
- 2026FoE: Forest of Errors Makes the First Solution the Best in Large Reasoning Modelscited by 8
- 2026Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented Generationcited by 5
- 2026OmniTrend: Content-Context Modeling for Scalable Social Popularity Predictioncited by 1
- 2026EmbGen: Teaching with Reassembled Corporacited by 0
- 2026EmbGen: Teaching with Reassembled Corpora19 May 2026
- 2026OmniTrend: Content-Context Modeling for Scalable Social Popularity Prediction29 Apr 2026
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrieval23 Apr 2026
- 2026FoE: Forest of Errors Makes the First Solution the Best in Large Reasoning Models3 Apr 2026
- 2026Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models16 Jan 2026
- 2026Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented Generation6 Jan 2026
- 2025Understanding LLM Reasoning for Abstractive Summarization3 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2024Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the Text
- 2025Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing
- 2024Can LLMs perform structured graph reasoning?
- 2024TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale
- 2023Evaluating Factual Consistency of Summaries with Large Language Models
- 2024Struct-X: Enhancing Large Language Models Reasoning with Structured Data
- 2026Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding
- 2024Prompting Large Language Models with Audio for General-Purpose Speech Summarization