mlsanityData to 14 Oct 2026

Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning

arXiv 2110.15703 ↗First posted 19 Sep 2021cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Irrespective of the success of the deep learning-based mixed-domain transfer learning approach for solving various Natural Language Processing tasks, it does not lend a generalizable solution for detecting misinformation from COVID-19 social media data. Due to the inherent complexity of this type of data, caused by its dynamic (context evolves rapidly), nuanced (misinformation types are often ambiguous), and diverse (skewed, fine-grained, and overlapping categories) nature, it is imperative for an effective model to capture both the local and global context of the target domain. By conducting a systematic investigation, we show that: (i) the deep Transformer-based pre-trained models, utilized via the mixed-domain transfer learning, are only good at capturing the local context, thus exhibits poor generalization, and (ii) a combination of shallow network-based domain-specific models and convolutional neural networks can efficiently extract local as well as global context directly from the target data in a hierarchical fashion, enabling it to offer a more generalizable solution.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 57 references that are in the map. First posted on arXiv 19 Sep 2021.

Builds on

26 of 57 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  8. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  9. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  10. 2018Deep contextualized word representationscited by 2,290
  11. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  12. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
14 more
  1. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
  2. 2018Graph Convolutional Networks for Text Classificationcited by 345
  3. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 306
  4. 2019To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Taskscited by 167
  5. 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
  6. 2020Deep Learning Based Text Classification: A Comprehensive Reviewcited by 141
  7. 2020COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twittercited by 96
  8. 2020CoAID: COVID-19 Healthcare Misinformation Datasetcited by 84
  9. 2016Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Poolingcited by 39
  10. 2020VGCN-BERT: Augmenting BERT with Graph Embedding for Text Classificationcited by 35
  11. 2020Characterizing COVID-19 Misinformation Communities Using a Novel Twitter Datasetcited by 32
  12. 2020ktrain: A Low-Code Library for Augmented Machine Learningcited by 23
  13. 2019On the Equivalence between Positional Node Embeddings and Structural Graph Representationscited by 7
  14. 2020Covid-19 infodemic reveals new tipping point epidemiology and a revised R formulacited by 1

Built on by

Cited by year

Citing papers per year: 2022: 2.

2 papers.