mlsanityData to 14 Oct 2026

Engram Neuron Inspired Adaptive Memorization for Lifelong Learning

arXiv 2610.14940 ↗First posted 10 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Lifelong learning enables artificial systems to adapt to changing environments. To achieve this, an effective artificial learner should dynamically reorganize past and new experiences, maintaining stability while enabling flexible knowledge integration. However, existing efforts primarily mitigate catastrophic forgetting, lacking the ability to adaptively update memory akin to biological systems. Here, by integrating the full memory life cycle of engram neurons into artificial learners, we propose a framework that constructs a structured memory from gradient representations, which regulates parameter updates and guides memory management. Through comprehensive evaluations on four benchmarks, our approach shows promising lifelong learning capability, maintaining stability over long task sequences and supporting flexible adaptation. Beyond the performance gains, our approach offers a computational perspective on robust and flexible lifelong learning, echoing mechanisms observed in biological memory systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

16 of 39 references.

References · 16

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  2. 2016Learning without Forgettingcited by 2,496
  3. 2016Matching Networks for One Shot Learningcited by 2,255
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,898
  5. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
  6. 2016Progressive Neural Networkscited by 1,361
  7. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,105
  8. 2018Experience Replay for Continual Learningcited by 1,095
  9. 2018Efficient Lifelong Learning with A-GEMcited by 1,058
  10. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
  11. 2017Lifelong Learning with Dynamically Expandable Networkscited by 694
  12. 2021Gradient Projection Memory for Continual Learningcited by 348
4 more
  1. 2020Adversarial Continual Learningcited by 142
  2. 2022Class-Incremental Continual Learning into the eXtended DER-versecited by 124
  3. 2023A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learningcited by 69
  4. 2023Loss-Curvature Matching for Dataset Selection and Condensationcited by 33

Built on by

Not cited yet.