mlsanityData to 7 Oct 2026

CEL: A Continual Learning Model for Disease Outbreak Prediction by Leveraging Domain Adaptation via Elastic Weight Consolidation

arXiv 2401.08940 ↗First posted 17 Jan 2024cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Continual learning, the ability of a model to learn over time without forgetting previous knowledge and, therefore, be adaptive to new data, is paramount in dynamic fields such as disease outbreak prediction. Deep neural networks, i.e., LSTM, are prone to error due to catastrophic forgetting. This study introduces a novel CEL model for continual learning by leveraging domain adaptation via Elastic Weight Consolidation (EWC). This model aims to mitigate the catastrophic forgetting phenomenon in a domain incremental setting. The Fisher Information Matrix (FIM) is constructed with EWC to develop a regularization term that penalizes changes to important parameters, namely, the important previous knowledge. CEL's performance is evaluated on three distinct diseases, Influenza, Mpox, and Measles, with different metrics. The high R-squared values during evaluation and reevaluation outperform the other state-of-the-art models in several contexts, indicating that CEL adapts to incremental data well. CEL's robustness and reliability are underscored by its minimal 65% forgetting rate and 18% higher memory stability compared to existing benchmark studies. This study highlights CEL's versatility in disease outbreak prediction, addressing evolving data with temporal patterns. It offers a valuable model for proactive disease control with accurate, timely predictions.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 17 Jan 2024.

Builds on

30 of 67 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  6. 2016Learning without Forgettingcited by 2,465
  7. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  8. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  9. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  10. 2017Continual Learning with Deep Generative Replaycited by 1,152
  11. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  12. 2018Experience Replay for Continual Learningcited by 1,074
18 more
  1. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  2. 2018Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigencecited by 734
  3. 2019Gradient based sample selection for online continual learningcited by 568
  4. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
  5. 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 242
  6. 2023Continual Pre-training of Language Modelscited by 194
  7. 2018Reinforced Continual Learningcited by 186
  8. 2019Class-incremental Learning via Deep Model Consolidationcited by 172
  9. 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
  10. 2018Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationcited by 104
  11. 2022An Efficient Domain-Incremental Learning Approach to Drive in All Weather Conditionscited by 54
  12. 2017Lifelong Generative Modelingcited by 51
  13. 2020Continual Learning for Anomaly Detection in Surveillance Videoscited by 49
  14. 2022CLAD: A realistic Continual Learning benchmark for Autonomous Drivingcited by 35
  15. 2022Continual Training of Language Models for Few-Shot Learningcited by 33
  16. 2021Elastic Weight Consolidation (EWC): Nuts and Boltscited by 21
  17. 2020Prediction error-driven memory consolidation for continual learning. On the case of adaptive greenhouse modelscited by 5
  18. 2021Comprehensive learning particle swarm optimization enabled modeling framework for multi-step-ahead influenza predictioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.