mlsanityData to 7 Oct 2026

Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English

arXiv 2101.02359 ↗First posted 7 Jan 2021cs.CL cs.AI cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

In this paper, we describe our system for the AAAI 2021 shared task of COVID-19 Fake News Detection in English, where we achieved the 3rd position with the weighted F1 score of 0.9859 on the test set. Specifically, we proposed an ensemble method of different pre-trained language models such as BERT, Roberta, Ernie, etc. with various training strategies including warm-up,learning rate schedule and k-fold cross-validation. We also conduct an extensive analysis of the samples that are not correctly classified. The code is available at:https://github.com/archersama/3rd-solution-COVID19-Fake-News-Detection-in-English.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 15 of its 20 references that are in the map. First posted on arXiv 7 Jan 2021.

Builds on

15 of 20 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2018Deep contextualized word representationscited by 2,285
  8. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
  9. 2019How to Fine-Tune BERT for Text Classification?cited by 409
  10. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
  11. 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 230
  12. 2020Fighting an Infodemic: COVID-19 Fake News Datasetcited by 82
3 more
  1. 2020Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learningcited by 23
  2. 2020Fake News Detection in Social Media using Graph Neural Networks and NLP Techniques: A COVID-19 Use-casecited by 12
  3. 2020Fake news agenda in the era of COVID-19: Identifying trends through fact-checking contentcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 3; 2023: 1; 2024: 2; 2025: 1; 2026: 1.

11 papers.

  1. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  2. 2021Categorising Fine-to-Coarse Grained Misinformation: An Empirical Study of COVID-19 Infodemiccited by 9
  3. 2022Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issuescited by 6
  4. 2023Automated multilingual detection of Pro-Kremlin propaganda in newspapers and Telegram postscited by 6
  5. 2021A Heuristic-driven Uncertainty based Ensemble Framework for Fake News Detection in Tweets and News Articlescited by 5
  6. 2022Low Resource Style Transfer via Domain Adaptive Meta Learningcited by 4
  7. 2025Beyond Detection: Exploring Evidence-based Multi-Agent Debate for Misinformation Intervention and Persuasioncited by 4
  8. 2024Multilingual Models for Check-Worthy Social Media Posts Detectioncited by 2
  9. 2021Automated Evidence Collection for Fake News Detectioncited by 0
  10. 2024Health Misinformation in Social Networks: A Survey of IT Approachescited by 0
  11. 2026A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagationcited by 0