mlsanityData to 7 Oct 2026

A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models

arXiv 2406.11289 ↗First posted 17 Jun 2024cs.CLcited by 52

Not on the map. Why?

Abstract (arXiv)

Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language models (LLMs). This survey thus provides a comprehensive review of the research progress and evolution in text summarization through the lens of these paradigm shifts. It is organized into two main parts: (1) a detailed overview of datasets, evaluation metrics, and summarization methods before the LLM era, encompassing traditional statistical methods, deep learning approaches, and PLM fine-tuning techniques, and (2) the first detailed examination of recent advancements in benchmarking, modeling, and evaluating summarization in the LLM era. By synthesizing existing literature and presenting a cohesive overview, this survey also discusses research trends, open challenges, and proposes promising research directions in summarization, aiming to guide researchers through the evolving landscape of summarization research.

Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). Builds on 194 of its 285 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

194 of 285 references.

References · 194

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  9. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  10. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  11. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  12. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
38 more
  1. 2017Graph Attention Networkscited by 8,854
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2017Deep reinforcement learning from human preferencescited by 3,846
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  9. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  10. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  11. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  12. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  13. 2020Learning to summarize from human feedbackcited by 2,562
  14. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  15. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  16. 2022SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Modelscited by 1,338
  17. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  18. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  19. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  20. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  21. 2015Teaching Machines to Read and Comprehendcited by 1,039
  22. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  23. 2015Pointer Networkscited by 882
  24. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  25. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  26. 2022A Survey on In-context Learningcited by 717
  27. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  28. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  29. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 578
  30. 2019Text Summarization with Pretrained Encoderscited by 553
  31. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 530
  32. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  33. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  34. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  35. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  36. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
  37. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
  38. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 376

50 most cited of 194 All 194 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 32; 2026: 17.

52 papers.

Sort:

By area:

  1. 2025WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Researchcited by 44
  2. 2024A Survey of Sustainability in Large Language Models: Applications, Economics, and Challengescited by 18
  3. 2025The Rogue Scalpel: Activation Steering Compromises LLM Safetycited by 18
  4. 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoningcited by 12
  5. 2025Teaching Large Language Models to Maintain Contextual Faithfulness via Synthetic Tasks and Reinforcement Learningcited by 7
  6. 2024ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Originationcited by 6
  7. 2025Document Summarization with Conformal Importance Guaranteescited by 6
  8. 2025Semantic Caching of Contextual Summaries for Efficient Question-Answering with Language Modelscited by 5
  9. 2025Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implicationscited by 5
  10. 2025KVSwap: Disk-aware KV Cache Offloading for Long-Context On-device Inferencecited by 5
  11. 2026HumanLLM: Towards Personalized Understanding and Simulation of Human Naturecited by 5
  12. 2025Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Modelscited by 3
38 more
  1. 2025Evaluating LLMs and Pre-trained Models for Text Summarization Across Diverse Datasetscited by 3
  2. 2025OpinioRAG: Towards Generating User-Centric Opinion Highlights from Large-scale Online Reviewscited by 3
  3. 2025KVCompose: Efficient Structured KV Cache Compression with Composite Tokenscited by 3
  4. 2025Optimizing Long-Form Clinical Text Generation with Claim-Based Rewardscited by 3
  5. 2025Balancing Rewards in Text Summarization: Multi-Objective Reinforcement Learning via HyperVolume Optimizationcited by 3
  6. 2025CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimizationcited by 3
  7. 2026MoDora: Tree-Based Semi-Structured Document Analysis Systemcited by 3
  8. 2025Evaluating the Effectiveness of Large Language Models in Automated News Article Summarizationcited by 2
  9. 2025RCPU: Rotation-Constrained Error Compensation for Structured Pruning of Large Language Modelscited by 2
  10. 2026TSM-Bench: Detecting LLM-Generated Text in Real-World Wikipedia Editing Practicescited by 2
  11. 2025Evaluating book summaries from internal knowledge in Large Language Models: a cross-model and semantic consistency approachcited by 1
  12. 2025News is More than a Collection of Facts: Moral Frame Preserving News Summarizationcited by 1
  13. 2025From Text to Graph: Leveraging Graph Neural Networks for Enhanced Explainability in NLPcited by 1
  14. 2025Ask, Retrieve, Summarize: A Modular Pipeline for Scientific Literature Summarizationcited by 1
  15. 2025MAGIC-Enhanced Keyword Prompting for Zero-Shot Audio Captioning with CLIP Modelscited by 1
  16. 2025Efficient Extractive Text Summarization for Online News Articles Using Machine Learningcited by 1
  17. 2025End-to-End Transformer Acceleration Through Processing-in-Memory Architecturescited by 1
  18. 2026From "Help" to Helpful: A Hierarchical Assessment of LLMs in Mental e-Health Applicationscited by 1
  19. 2026Position: Natural Language Should Not Fully Replace Formal Languagescited by 1
  20. 2024DocSum: Domain-Adaptive Pre-training for Document Abstractive Summarizationcited by 0
  21. 2025Summarization of Multimodal Presentations with Vision-Language Models: Study of the Effect of Modalities and Structurecited by 0
  22. 2025LLMs are Introvertcited by 0
  23. 2025Fair Representation in Parliamentary Summaries: Measuring and Mitigating Inclusion Biascited by 0
  24. 2025CABENCH: Benchmarking Composable AI for Solving Complex Tasks through Composing Ready-to-Use Modelscited by 0
  25. 2025VA-Blueprint: Uncovering Building Blocks for Visual Analytics System Designcited by 0
  26. 2025An Empirical Study of Sample Selection Strategies for Large Language Model Repaircited by 0
  27. 2025Intelligence Foundation Model: A New Perspective to Approach Artificial General Intelligencecited by 0
  28. 2025Progressive Code Integration for Abstractive Bug Report Summarizationcited by 0
  29. 2026DiSCo: Making Absence Visible in Intelligent Summarization Interfacescited by 0
  30. 2026LLM or Human? Perceptions of Trust and Information Quality in Research Summariescited by 0
  31. 2026Beyond Pipelines: A Fundamental Study on the Rise of Generative-Retrieval Architectures in Web Researchcited by 0
  32. 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0
  33. 2026ShapE-GRPO: Shapley-Enhanced Reward Allocation for Multi-Candidate LLM Trainingcited by 0
  34. 2026LLM-ReSum: A Framework for LLM Reflective Summarization through Self-Evaluationcited by 0
  35. 2026Computational conceptual history of scientific concepts: From early digital methods to LLMscited by 0
  36. 2026Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decompositioncited by 0
  37. 2026Semi-Supervised Text-Attributed Graph Distillationcited by 0
  38. 2026Unified Static-Dynamic Pruning for Efficient LLM Inferencecited by 0

50 most cited of 52 All 52 (JSON)