mlsanityData to 7 Oct 2026

Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task

arXiv 2101.11425 ↗First posted 12 Jan 2021cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

With the ease of access to information, and its rapid dissemination over the internet (both velocity and volume), it has become challenging to filter out truthful information from fake ones. The research community is now faced with the task of automatic detection of fake news, which carries real-world socio-political impact. One such research contribution came in the form of the Constraint@AAA12021 Shared Task on COVID19 Fake News Detection in English. In this paper, we shed light on a novel method we proposed as a part of this shared task. Our team introduced an approach to combine topical distributions from Latent Dirichlet Allocation (LDA) with contextualized representations from XLNet. We also compared our method with existing baselines to show that XLNet + Topic Distributions outperforms other approaches by attaining an F1-score of 0.967.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 12 Jan 2021.

Builds on

14 of 23 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  3. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  4. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  5. 2019How to Fine-Tune BERT for Text Classification?cited by 409
  6. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
  7. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  8. 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
  9. 2017Automatic Detection of Fake Newscited by 145
  10. 2017CSI: A Hybrid Deep Model for Fake News Detectioncited by 101
  11. 2020Fighting an Infodemic: COVID-19 Fake News Datasetcited by 82
  12. 2019MultiFiT: Efficient Multi-lingual Language Model Fine-tuningcited by 31
2 more
  1. 2020A Deep Learning Approach for Automatic Detection of Fake Newscited by 7
  2. 2020NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Trainingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 0; 2025: 1; 2026: 1.

6 papers.