Dynamically Addressing Unseen Rumor via Continual Learning
Not on the map. Why?
Abstract (arXiv)
Rumors are often associated with newly emerging events, thus, an ability to deal with unseen rumors is crucial for a rumor veracity classification model. Previous works address this issue by improving the model's generalizability, with an assumption that the model will stay unchanged even after the new outbreak of an event. In this work, we propose an alternative solution to continuously update the model in accordance with the dynamics of rumor domain creations. The biggest technical challenge associated with this new approach is the catastrophic forgetting of previous learnings due to new learnings. We adopt continual learning strategies that control the new learnings to avoid catastrophic forgetting and propose an additional strategy that can jointly be used to strengthen the forgetting alleviation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 18 Apr 2021.
Builds on
17 of 30 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2019Episodic Memory in Lifelong Language Learningcited by 188
- 2019LAMOL: LAnguage MOdeling for Lifelong Language Learningcited by 156
- 2017Detection and Resolution of Rumours in Social Media: A Surveycited by 103
- 2017SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumourscited by 77
- 2021Towards Few-Shot Fact-Checking via Perplexitycited by 63
- 2018All-in-one: Multi-task Learning for Rumour Verificationcited by 54
- 2020Efficient Meta Lifelong-Learning with Limited Memorycited by 48
- 2018Memory-based Parameter Adaptationcited by 35
5 more
- 2020Drinking from a Firehose: Continual Learning with Web-scale Natural Languagecited by 24
- 2019Continual Learning for Sentence Representations Using Conceptorscited by 22
- 2019Different Absorption from the Same Sharing: Sifted Multi-task Learning for Fake News Detectioncited by 11
- 2021Model Generalization on COVID-19 Fake News Detectioncited by 11
- 2021On Unifying Misinformation Detectioncited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 0; 2024: 0; 2025: 1.
3 papers.