mlsanityData to 7 Oct 2026

Automated News Summarization Using Transformers

arXiv 2108.01064 ↗First posted 23 Apr 2021cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually generating precise and fluent summaries of lengthy articles is a very tiresome and time-consuming task. Hence generating automated summaries for the data and using it to train machine learning models will make these models space and time-efficient. Extractive summarization and abstractive summarization are two separate methods of generating summaries. The extractive technique identifies the relevant sentences from the original document and extracts only those from the text. Whereas in abstractive summarization techniques, the summary is generated after interpreting the original text, hence making it more complicated. In this paper, we will be presenting a comprehensive comparison of a few transformer architecture based pre-trained models for text summarization. For analysis and comparison, we have used the BBC news dataset that contains text data that can be used for summarization and human generated summaries for evaluating and comparing the summaries generated by machine learning models.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 23 Apr 2021.

Builds on

11 of 21 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  6. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  7. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  8. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  9. 2013Generating Sequences With Recurrent Neural Networkscited by 549
  10. 2017Text Summarization Techniques: A Brief Surveycited by 59
  11. 2018Neural Abstractive Text Summarization with Sequence-to-Sequence Modelscited by 39

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 7; 2024: 2.

11 papers.