mlsanityData to 14 Oct 2026

Advancements in Natural Language Processing for Automatic Text Summarization

arXiv 2502.19773 ↗First posted 27 Feb 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

The substantial growth of textual content in diverse domains and platforms has led to a considerable need for Automatic Text Summarization (ATS) techniques that aid in the process of text analysis. The effectiveness of text summarization models has been significantly enhanced in a variety of technical domains because of advancements in Natural Language Processing (NLP) and Deep Learning (DL). Despite this, the process of summarizing textual information continues to be significantly constrained by the intricate writing styles of a variety of texts, which involve a range of technical complexities. Text summarization techniques can be broadly categorized into two main types: abstractive summarization and extractive summarization. Extractive summarization involves directly extracting sentences, phrases, or segments of text from the content without making any changes. On the other hand, abstractive summarization is achieved by reconstructing the sentences, phrases, or segments from the original text using linguistic analysis. Through this study, a linguistically diverse categorizations of text summarization approaches have been addressed in a constructive manner. In this paper, the authors explored existing hybrid techniques that have employed both extractive and abstractive methodologies. In addition, the pros and cons of various approaches discussed in the literature are also investigated. Furthermore, the authors conducted a comparative analysis on different techniques and matrices to evaluate the generated summaries using language generation models. This survey endeavors to provide a comprehensive overview of ATS by presenting the progression of language processing regarding this task through a breakdown of diverse systems and architectures accompanied by technical and mathematical explanations of their operations.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 53 references that are in the map. First posted on arXiv 27 Feb 2025.

Builds on

15 of 53 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  5. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 396
  6. 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
  7. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  8. 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
  9. 2019On Extractive and Abstractive Neural Document Summarization with Transformer Language Modelscited by 83
  10. 2022ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generationcited by 37
  11. 2019Sample Efficient Text Summarization Using a Single Pre-Trained Transformercited by 27
  12. 2018Abstractive Text Summarization by Incorporating Reader Commentscited by 15
3 more
  1. 2015Generating News Headlines with Recurrent Neural Networkscited by 10
  2. 2021Summaformers @ LaySumm 20, LongSumm 20cited by 4
  3. 2020An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domaincited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.