Applying Automatic Text Summarization for Fake News Detection
Not on the map. Why?
Abstract (arXiv)
The distribution of fake news is not a new but a rapidly growing problem. The shift to news consumption via social media has been one of the drivers for the spread of misleading and deliberately wrong information, as in addition to it of easy use there is rarely any veracity monitoring. Due to the harmful effects of such fake news on society, the detection of these has become increasingly important. We present an approach to the problem that combines the power of transformer-based language models while simultaneously addressing one of their inherent problems. Our framework, CMTR-BERT, combines multiple text representations, with the goal of circumventing sequential limits and related loss of information the underlying transformer architecture typically suffers from. Additionally, it enables the incorporation of contextual information. Extensive experiments on two very different, publicly available datasets demonstrates that our approach is able to set new state-of-the-art performance benchmarks. Apart from the benefit of using automatic text summarization techniques we also find that the incorporation of contextual information contributes to performance gains.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 37 of its 85 references that are in the map. First posted on arXiv 4 Apr 2022.
Builds on
37 of 85 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2015Teaching Machines to Read and Comprehendcited by 1,049
25 more
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
- 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 301
- 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
- 2016Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learningcited by 195
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2016Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challengecited by 116
- 2019Hierarchical Transformers for Long Document Classificationcited by 104
- 2019Leveraging BERT for Extractive Text Summarization on Lecturescited by 63
- 2018A Retrospective Analysis of the Fake News Challenge Stance Detection Taskcited by 49
- 2020ReCOVery: A Multimodal Repository for COVID-19 News Credibility Researchcited by 44
- 2017Generating High-Quality and Informative Conversation Responses with Sequence-to-Sequence Modelscited by 42
- 2020An Exploratory Study of COVID-19 Misinformation on Twittercited by 33
- 2019Hierarchical Propagation Networks for Fake News Detection: Investigation and Exploitationcited by 32
- 2019Fake News Early Detection: An Interdisciplinary Studycited by 29
- 2019NELA-GT-2018: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 26
- 2017Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detectioncited by 25
- 2017Fake News Mitigation via Point Process Based Interventioncited by 24
- 2020Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learningcited by 23
- 2019Enriching BERT with Knowledge Graph Embeddings for Document Classificationcited by 22
- 2019Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Modelscited by 20
- 2017Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformationcited by 12
- 2020Connecting the Dots Between Fact Verification and Fake News Detectioncited by 8
- 2021NoFake at CheckThat! 2021: Fake News Detection Using BERTcited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 1.
4 papers.
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 102
- 2025Truth over Tricks: Measuring and Mitigating Shortcut Learning in Misinformation Detectioncited by 8
- 2022Exploring Fake News Detection with Heterogeneous Social Media Context Graphscited by 2
- 2024Challenges in Pre-Training Graph Neural Networks for Context-Based Fake News Detection: An Evaluation of Current Strategies and Resource Limitationscited by 2
- 2025Truth over Tricks: Measuring and Mitigating Shortcut Learning in Misinformation Detection3 Jun 2025
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Challenges in Pre-Training Graph Neural Networks for Context-Based Fake News Detection: An Evaluation of Current Strategies and Resource Limitations28 Feb 2024
- 2022Exploring Fake News Detection with Heterogeneous Social Media Context Graphs13 Dec 2022