mlsanityData to 14 Oct 2026

Variational Continual Learning

arXiv 1710.10628 ↗First posted 29 Oct 2017stat.ML cs.LGcited by 339

Not on the map. Why?

Abstract (arXiv)

This paper develops variational continual learning (VCL), a simple but general framework for continual learning that fuses online variational inference (VI) and recent advances in Monte Carlo VI for neural networks. The framework can successfully train both deep discriminative models and deep generative models in complex continual learning settings where existing tasks evolve over time and entirely new tasks emerge. Experimental results show that VCL outperforms state-of-the-art continual learning methods on a variety of tasks, avoiding catastrophic forgetting in a fully automatic way.

Key facts. Cited by 339 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 85; 2022: 54; 2023: 66; 2024: 61; 2025: 46; 2026: 27.

339 papers.

Sort:

By area:

  1. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  2. 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
  3. 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 365
  4. 2021Online Continual Learning in Image Classification: An Empirical Surveycited by 245
  5. 2023Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Modelscited by 177
  6. 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 143
  7. 2023Continual Pre-Training of Large Language Models: How to (re)warm your model?cited by 137
  8. 2021Online Coreset Selection for Rehearsal-based Continual Learningcited by 117
  9. 2021Continual World: A Robotic Benchmark For Continual Reinforcement Learningcited by 116
  10. 2021Semantic-aware Knowledge Distillation for Few-Shot Class-Incremental Learningcited by 115
  11. 2022Remember the Past: Distilling Datasets into Addressable Memories for Neural Networkscited by 104
  12. 2023A Definition of Continual Reinforcement Learningcited by 101
38 more
  1. 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 87
  2. 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 83
  3. 2021Continual Learning of a Mixed Sequence of Similar and Dissimilar Taskscited by 81
  4. 2022How catastrophic can catastrophic forgetting be in linear regression?cited by 81
  5. 2024Continual Learning and Catastrophic Forgettingcited by 77
  6. 2022Probing Representation Forgetting in Supervised and Unsupervised Continual Learningcited by 76
  7. 2021AFEC: Active Forgetting of Negative Transfer in Continual Learningcited by 73
  8. 2021Replay in Deep Learning: Current Approaches and Missing Biological Elementscited by 72
  9. 2021Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learningcited by 72
  10. 2021Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual Datacited by 69
  11. 2023A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learningcited by 69
  12. 2021Wide Neural Networks Forget Less Catastrophicallycited by 64
  13. 2021Continual Learning via Local Module Compositioncited by 63
  14. 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 62
  15. 2024Synthetic continued pretrainingcited by 60
  16. 2021Recent Advances of Continual Learning in Computer Vision: An Overviewcited by 55
  17. 2021Model Zoo: A Growing "Brain" That Learns Continuallycited by 54
  18. 2024Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learningcited by 53
  19. 2025Can Prompt Difficulty be Online Predicted for Accelerating RL Finetuning of Reasoning Models?cited by 52
  20. 2021Layerwise Optimization by Gradient Decomposition for Continual Learningcited by 51
  21. 2021Efficient Feature Transformations for Discriminative and Generative Continual Learningcited by 50
  22. 2021Powerpropagation: A sparsity inducing weight reparameterisationcited by 49
  23. 2021Natural continual learning: success is a journey, not (just) a destinationcited by 46
  24. 2021Posterior Meta-Replay for Continual Learningcited by 45
  25. 2021Same State, Different Task: Continual Reinforcement Learning without Interferencecited by 43
  26. 2022Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priorscited by 43
  27. 2022Information-theoretic Online Memory Selection for Continual Learningcited by 42
  28. 2021A Bayesian Federated Learning Framework with Online Laplace Approximationcited by 41
  29. 2022Continual Normalization: Rethinking Batch Normalization for Online Continual Learningcited by 40
  30. 2022Modular Lifelong Reinforcement Learning via Neural Compositioncited by 40
  31. 2021Class-Incremental Learning with Generative Classifierscited by 39
  32. 2021Continual Learning for Blind Image Quality Assessmentcited by 36
  33. 2021Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learningcited by 35
  34. 2021Continual Learning for Recurrent Neural Networks: an Empirical Evaluationcited by 34
  35. 2022Disentangling Transfer in Continual Reinforcement Learningcited by 33
  36. 2023A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithmcited by 33
  37. 2021Continual Learning via Bit-Level Information Preservingcited by 32
  38. 2022Continual Learning with Recursive Gradient Optimizationcited by 32

50 most cited of 339 All 339 (JSON)