mlsanityData to 14 Oct 2026

Fake news detection using parallel BERT deep neural networks

arXiv 2204.04793 ↗First posted 10 Apr 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Fake news is a growing challenge for social networks and media. Detection of fake news always has been a problem for many years, but after the evolution of social networks and increasing speed of news dissemination in recent years has been considered again. There are several approaches to solving this problem, one of which is to detect fake news based on its text style using deep neural networks. In recent years, one of the most used forms of deep neural networks for natural language processing is transfer learning with transformers. BERT is one of the most promising transformers who outperforms other models in many NLP benchmarks. This article, we introduce MWPBert, which uses two parallel BERT networks to perform veracity detection on full-text news articles. One of the BERT networks encodes news headline, and another encodes news body. Since the input length of the BERT network is limited and constant and the news body is usually a long text, we cannot fed the whole news text into the BERT. Therefore, using the MaxWorth algorithm, we selected the part of the news text that is more valuable for fact-checking, and fed it into the BERT network. Finally, we encode the output of the two BERT networks to an output network to classify the news. The experiment results showed that the proposed model outperformed previous models in terms of accuracy and other performance measures.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 46 references that are in the map. First posted on arXiv 10 Apr 2022.

Builds on

17 of 46 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  8. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  9. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
  10. 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
  11. 2019Text Classification Algorithms: A Surveycited by 163
  12. 2018Dissecting Contextual Word Embeddings: Architecture and Representationcited by 146
5 more
  1. 2017Automatic Detection of Fake Newscited by 145
  2. 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
  3. 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
  4. 2019Learning Hierarchical Discourse-level Structure for Fake News Detectioncited by 28
  5. 2019False News On Social Media: A Data-Driven Surveycited by 9

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.