mlsanityData to 14 Oct 2026

A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods

arXiv 2403.02901 ↗First posted 5 Mar 2024cs.AIcited by 102

Not on the map. Why?

Abstract (arXiv)

Automatic Text Summarization (ATS), utilizing Natural Language Processing (NLP) algorithms, aims to create concise and accurate summaries, thereby significantly reducing the human effort required in processing large volumes of text. ATS has drawn considerable interest in both academic and industrial circles. Many studies have been conducted in the past to survey ATS methods; however, they generally lack practicality for real-world implementations, as they often categorize previous methods from a theoretical standpoint. Moreover, the advent of Large Language Models (LLMs) has altered conventional ATS methods. In this survey, we aim to 1) provide a comprehensive overview of ATS from a ``Process-Oriented Schema'' perspective, which is best aligned with real-world implementations; 2) comprehensively review the latest LLM-based ATS works; and 3) deliver an up-to-date survey of ATS, bridging the two-year gap in the literature. To the best of our knowledge, this is the first survey to specifically investigate LLM-based ATS methods.

Key facts. Cited by 102 papers in the map (data through 14 Oct 2026). Builds on 219 of its 428 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

219 of 428 references.

References · 219

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  8. 2017Graph Attention Networkscited by 8,923
  9. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  10. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  12. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
38 more
  1. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  4. 2020Learning to summarize from human feedbackcited by 2,588
  5. 2023A Survey of Large Language Modelscited by 2,576
  6. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  7. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  9. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  10. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  11. 2020Knowledge Distillation: A Surveycited by 1,603
  12. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  13. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  14. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  15. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  16. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  17. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
  18. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  19. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  20. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  21. 2015Teaching Machines to Read and Comprehendcited by 1,049
  22. 2019How Can We Know What Language Models Know?cited by 959
  23. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  24. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  25. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
  26. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  27. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  28. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  29. 2019Text Summarization with Pretrained Encoderscited by 556
  30. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
  31. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
  32. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 478
  33. 2023Benchmarking Large Language Models for News Summarizationcited by 445
  34. 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
  35. 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
  36. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  37. 2023SLiC-HF: Sequence Likelihood Calibration with Human Feedbackcited by 401
  38. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 396

50 most cited of 219 All 219 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 27; 2025: 54; 2026: 21.

102 papers.

Sort:

By area:

  1. 2025AgentPRM: Process Reward Models for LLM Agents via Step-Wise Promise and Progresscited by 77
  2. 2024Imprompter: Tricking LLM Agents into Improper Tool Usecited by 68
  3. 2025Understanding (Un)Reliability of Steering Vectors in Language Modelscited by 47
  4. 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Modelscited by 44
  5. 2025Evaluating Scoring Bias in LLM-as-a-Judgecited by 43
  6. 2025LongMamba: Enhancing Mamba's Long Context Capabilities via Training-Free Receptive Field Enlargementcited by 42
  7. 2024Queue management for slo-oriented large language model servingcited by 36
  8. 2024Heuristic-Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Modelscited by 33
  9. 2025KramaBench: A Benchmark for AI Systems on Data-to-Insight Pipelines over Data Lakescited by 33
  10. 2025A Survey on Parallel Text Generation: From Parallel Decoding to Diffusion Language Modelscited by 30
  11. 2025Jailbreak-AudioBench: In-Depth Evaluation and Analysis of Jailbreak Threats for Large Audio Language Modelscited by 23
  12. 2024Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learningcited by 21
38 more
  1. 2024Black-box Uncertainty Quantification Method for LLM-as-a-Judgecited by 18
  2. 2025GraphEval: A Lightweight Graph-Based LLM Framework for Idea Evaluationcited by 17
  3. 2025EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corporacited by 15
  4. 2025AgentMaster: A Multi-Agent Conversational Framework Using A2A and MCP Protocols for Multimodal Information Retrieval and Analysiscited by 13
  5. 2025HiBench: Benchmarking LLMs Capability on Hierarchical Structure Reasoningcited by 12
  6. 2026Text summarization via global structure awarenesscited by 12
  7. 2025SciReasoner: Laying the Scientific Reasoning Ground Across Disciplinescited by 11
  8. 2025Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?cited by 10
  9. 2024Natural Language Outlines for Code: Literate Programming in the LLM Eracited by 9
  10. 2025Evaluation and Facilitation of Online Discussions in the LLM Era: A Surveycited by 9
  11. 2025RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integrationcited by 9
  12. 2025A Lightweight Large Language Model-Based Multi-Agent System for 2D Frame Structural Analysiscited by 9
  13. 2025Scaling Down Text Encoders of Text-to-Image Diffusion Modelscited by 8
  14. 2024KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregationcited by 7
  15. 2025Hybrid Graphs for Table-and-Text based Question Answering using LLMscited by 7
  16. 2025Enhancing Decision-Making of Large Language Models via Actor-Criticcited by 7
  17. 2025Serialized EHR make for good text representationscited by 7
  18. 2024Multi-Document Financial Question Answering using LLMscited by 6
  19. 2025SelfReflect: Can LLMs Communicate Their Internal Answer Distribution?cited by 6
  20. 2025Preacher: Paper-to-Video Agentic Systemcited by 6
  21. 2024Evalverse: Unified and Accessible Library for Large Language Model Evaluationcited by 5
  22. 2024ConServe: Fine-Grained GPU Harvesting for LLM Online and Offline Co-Servingcited by 5
  23. 2024Exploring Prompt Engineering: A Systematic Review with SWOT Analysiscited by 5
  24. 2024CausalMob: Causal Human Mobility Prediction with LLMs-derived Human Intentions toward Public Eventscited by 5
  25. 2026LLM Review: Enhancing Creative Writing via Blind Peer Review Feedbackcited by 5
  26. 2026Geometry-Calibrated Conformal Abstention for Language Modelscited by 5
  27. 2024Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graphcited by 4
  28. 2024Enhancing Incremental Summarization with Structured Representationscited by 4
  29. 2024MLD-EA: Check and Complete Narrative Coherence by Introducing Emotions and Actionscited by 4
  30. 2025CodeEdu: A Multi-Agent Collaborative Platform for Personalized Coding Educationcited by 4
  31. 2025Knowledge-Level Consistency Reinforcement Learning: Dual-Fact Alignment for Long-Form Factualitycited by 4
  32. 2025R-Debater: Retrieval-Augmented Debate Generation through Argumentative Memorycited by 4
  33. 2024DoPAMine: Domain-specific Pre-training Adaptation from seed-guided data Miningcited by 3
  34. 2024Controlled Automatic Task-Specific Synthetic Data Generation for Hallucination Detectioncited by 3
  35. 2025From Documents to Dialogue: Building KG-RAG Enhanced AI Assistantscited by 3
  36. 2025ArgCMV: An Argument Summarization Benchmark for the LLM-eracited by 3
  37. 2025BLUEX Revisited: Enhancing Benchmark Coverage with Automatic Captioningcited by 3
  38. 2025Towards Adaptive Context Management for Intelligent Conversational Question Answeringcited by 3

50 most cited of 102 All 102 (JSON)