Automated News Summarization Using Transformers
Not on the map. Why?
Abstract (arXiv)
The amount of text data available online is increasing at a very fast pace hence text summarization has become essential. Most of the modern recommender and text classification systems require going through a huge amount of data. Manually generating precise and fluent summaries of lengthy articles is a very tiresome and time-consuming task. Hence generating automated summaries for the data and using it to train machine learning models will make these models space and time-efficient. Extractive summarization and abstractive summarization are two separate methods of generating summaries. The extractive technique identifies the relevant sentences from the original document and extracts only those from the text. Whereas in abstractive summarization techniques, the summary is generated after interpreting the original text, hence making it more complicated. In this paper, we will be presenting a comprehensive comparison of a few transformer architecture based pre-trained models for text summarization. For analysis and comparison, we have used the BBC news dataset that contains text data that can be used for summarization and human generated summaries for evaluating and comparing the summaries generated by machine learning models.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 11 of its 21 references that are in the map. First posted on arXiv 23 Apr 2021.
Builds on
11 of 21 references.
References · 11
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
- 2017Text Summarization Techniques: A Brief Surveycited by 59
- 2018Neural Abstractive Text Summarization with Sequence-to-Sequence Modelscited by 39
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 2.
11 papers.
- 2023Language Model Self-improvement by Reinforcement Learning Contemplationcited by 75
- 2024Graph Transformers: A Surveycited by 32
- 2022What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generationcited by 8
- 2023Framing the News:From Human Perception to Large Language Model Inferencescited by 7
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contentscited by 7
- 2023Core Building Blocks: Next Gen Geo Spatial GPT Applicationcited by 4
- 2022Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using Transformerscited by 3
- 2024Enhancing Transformer RNNs with Multiple Temporal Perspectivescited by 2
- 2023Abstractive Text Summarization for Resumes With Cutting Edge NLP Transformers and LSTMcited by 0
- 2023Speed Reading Tool Powered by Artificial Intelligence for Students with ADHD, Dyslexia, and Short Attention Spancited by 0
- 2023Pressmatch: Automated journalist recommendation for media coverage with Nearest Neighbor searchcited by 0
- 2024Graph Transformers: A Survey13 Jul 2024
- 2024Enhancing Transformer RNNs with Multiple Temporal Perspectives4 Feb 2024
- 2023Core Building Blocks: Next Gen Geo Spatial GPT Application17 Oct 2023
- 2023Pressmatch: Automated journalist recommendation for media coverage with Nearest Neighbor search2 Sep 2023
- 2023Speed Reading Tool Powered by Artificial Intelligence for Students with ADHD, Dyslexia, and Short Attention Span26 Jul 2023
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contents24 Jun 2023
- 2023Abstractive Text Summarization for Resumes With Cutting Edge NLP Transformers and LSTM23 Jun 2023
- 2023Language Model Self-improvement by Reinforcement Learning Contemplation23 May 2023
- 2023Framing the News:From Human Perception to Large Language Model Inferences27 Apr 2023
- 2022Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using Transformers21 Apr 2022
- 2022What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation18 Jan 2022