Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task
Not on the map. Why?
Abstract (arXiv)
With the ease of access to information, and its rapid dissemination over the internet (both velocity and volume), it has become challenging to filter out truthful information from fake ones. The research community is now faced with the task of automatic detection of fake news, which carries real-world socio-political impact. One such research contribution came in the form of the Constraint@AAA12021 Shared Task on COVID19 Fake News Detection in English. In this paper, we shed light on a novel method we proposed as a part of this shared task. Our team introduced an approach to combine topical distributions from Latent Dirichlet Allocation (LDA) with contextualized representations from XLNet. We also compared our method with existing baselines to show that XLNet + Topic Distributions outperforms other approaches by attaining an F1-score of 0.967.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 12 Jan 2021.
Builds on
14 of 23 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 361
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
- 2017Automatic Detection of Fake Newscited by 145
- 2017CSI: A Hybrid Deep Model for Fake News Detectioncited by 101
- 2020Fighting an Infodemic: COVID-19 Fake News Datasetcited by 82
- 2019MultiFiT: Efficient Multi-lingual Language Model Fine-tuningcited by 31
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 0; 2025: 1; 2026: 1.
6 papers.
- 2022A Multi-task Model for Sentiment Aided Stance Detection of Climate Change Tweetscited by 11
- 2021A Heuristic-driven Uncertainty based Ensemble Framework for Fake News Detection in Tweets and News Articlescited by 5
- 2023MisRoBAERTa: Transformers versus Misinformationcited by 4
- 2025DRES: Fake news detection by dynamic representation and ensemble selectioncited by 3
- 2022A Comparative Study on COVID-19 Fake News Detection Using Different Transformer Based Modelscited by 2
- 2026A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagationcited by 0
- 2026A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagation31 Aug 2026
- 2025DRES: Fake news detection by dynamic representation and ensemble selection21 Sep 2025
- 2023MisRoBAERTa: Transformers versus Misinformation16 Apr 2023
- 2022A Multi-task Model for Sentiment Aided Stance Detection of Climate Change Tweets7 Nov 2022
- 2022A Comparative Study on COVID-19 Fake News Detection Using Different Transformer Based Models2 Aug 2022
- 2021A Heuristic-driven Uncertainty based Ensemble Framework for Fake News Detection in Tweets and News Articles5 Apr 2021