mlsanityData to 14 Oct 2026

StrucSum: Graph-Structured Reasoning for Long Document Extractive Summarization with LLMs

arXiv 2505.22950 ↗First posted 29 May 2025cs.CLcited by 7

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) have shown strong performance in zero-shot summarization, but often struggle to model document structure and identify salient information in long texts. In this work, we introduce StrucSum, a training-free prompting framework that enhances LLM reasoning through sentence-level graph structures. StrucSum injects structural signals into prompts via three targeted strategies: Neighbor-Aware Prompting (NAP) for local context, Centrality-Aware Prompting (CAP) for importance estimation, and Centrality-Guided Masking (CGM) for efficient input reduction. Experiments on ArXiv, PubMed, and Multi-News demonstrate that StrucSum consistently improves both summary quality and factual consistency over unsupervised baselines and vanilla prompting. In particular, on ArXiv, it increases FactCC and SummaC by 19.2% and 8.0% points, demonstrating stronger alignment between summaries and source content. The ablation study shows that the combination of multiple strategies does not yield clear performance gains; therefore, structure-aware prompting with graph-based information represents a promising and underexplored direction for the advancement of zero-shot extractive summarization with LLMs. Our source code is publicly available.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 26 of its 34 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

26 of 34 references.

References · 26

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  5. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  6. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
  7. 2023Benchmarking Large Language Models for News Summarizationcited by 445
  8. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  9. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  10. 2022News Summarization and Evaluation in the Era of GPT-3cited by 327
  11. 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 91
  12. 2024FineSurE: Fine-grained Summarization Evaluation using LLMscited by 83
14 more
  1. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  2. 2020Leveraging Graph to Improve Abstractive Multi-Document Summarizationcited by 67
  3. 2019Sentence Centrality Revisited for Unsupervised Summarizationcited by 65
  4. 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 59
  5. 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarizationcited by 32
  6. 2022HEGEL: Hypergraph Transformer for Long Document Summarizationcited by 28
  7. 2024Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Biascited by 28
  8. 2022HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Informationcited by 26
  9. 2020Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networkscited by 22
  10. 2025Discourse-Driven Evaluation: Unveiling Factual Inconsistency in Long Document Summarizationcited by 8
  11. 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5
  12. 2024DomainSum: A Hierarchical Benchmark for Fine-Grained Domain Shift in Abstractive Text Summarizationcited by 4
  13. 2025QA-prompting: Improving Summarization with Large Language Models using Question-Answeringcited by 4
  14. 2025UMB@PerAnsSumm 2025: Enhancing Perspective-Aware Summarization with Prompt Optimization and Supervised Fine-Tuningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Structure Guided Prompt: Instructing Large Language Model in Multi-Step Reasoning by Exploring Graph Structure of the Text
  2. 2025Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing
  3. 2024Can LLMs perform structured graph reasoning?
  4. 2024TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale
  5. 2023Evaluating Factual Consistency of Summaries with Large Language Models
  6. 2024Struct-X: Enhancing Large Language Models Reasoning with Structured Data
  7. 2026Highlight-Then-Summarize: Learning to Compress Evidence for Long-Context Understanding
  8. 2024Prompting Large Language Models with Audio for General-Purpose Speech Summarization