mlsanityData to 14 Oct 2026

Applying Automatic Text Summarization for Fake News Detection

arXiv 2204.01841 ↗First posted 4 Apr 2022cs.CL cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

The distribution of fake news is not a new but a rapidly growing problem. The shift to news consumption via social media has been one of the drivers for the spread of misleading and deliberately wrong information, as in addition to it of easy use there is rarely any veracity monitoring. Due to the harmful effects of such fake news on society, the detection of these has become increasingly important. We present an approach to the problem that combines the power of transformer-based language models while simultaneously addressing one of their inherent problems. Our framework, CMTR-BERT, combines multiple text representations, with the goal of circumventing sequential limits and related loss of information the underlying transformer architecture typically suffers from. Additionally, it enables the incorporation of contextual information. Extensive experiments on two very different, publicly available datasets demonstrates that our approach is able to set new state-of-the-art performance benchmarks. Apart from the benefit of using automatic text summarization techniques we also find that the incorporation of contextual information contributes to performance gains.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 37 of its 85 references that are in the map. First posted on arXiv 4 Apr 2022.

Builds on

37 of 85 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  7. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  8. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  9. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  10. 2018Hierarchical Neural Story Generationcited by 1,193
  11. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  12. 2015Teaching Machines to Read and Comprehendcited by 1,049
25 more
  1. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  2. 2021A Survey on Automated Fact-Checkingcited by 378
  3. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
  4. 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 301
  5. 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
  6. 2016Imbalanced-learn: A Python Toolbox to Tackle the Curse of Imbalanced Datasets in Machine Learningcited by 195
  7. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  8. 2016Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challengecited by 116
  9. 2019Hierarchical Transformers for Long Document Classificationcited by 104
  10. 2019Leveraging BERT for Extractive Text Summarization on Lecturescited by 63
  11. 2018A Retrospective Analysis of the Fake News Challenge Stance Detection Taskcited by 49
  12. 2020ReCOVery: A Multimodal Repository for COVID-19 News Credibility Researchcited by 44
  13. 2017Generating High-Quality and Informative Conversation Responses with Sequence-to-Sequence Modelscited by 42
  14. 2020An Exploratory Study of COVID-19 Misinformation on Twittercited by 33
  15. 2019Hierarchical Propagation Networks for Fake News Detection: Investigation and Exploitationcited by 32
  16. 2019Fake News Early Detection: An Interdisciplinary Studycited by 29
  17. 2019NELA-GT-2018: A Large Multi-Labelled News Dataset for The Study of Misinformation in News Articlescited by 26
  18. 2017Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detectioncited by 25
  19. 2017Fake News Mitigation via Point Process Based Interventioncited by 24
  20. 2020Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learningcited by 23
  21. 2019Enriching BERT with Knowledge Graph Embeddings for Document Classificationcited by 22
  22. 2019Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Modelscited by 20
  23. 2017Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformationcited by 12
  24. 2020Connecting the Dots Between Fact Verification and Fake News Detectioncited by 8
  25. 2021NoFake at CheckThat! 2021: Fake News Detection Using BERTcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 1.

4 papers.