Neuroscience-Inspired Memory Replay for Continual Learning: A Comparative Study of Predictive Coding and Backpropagation-Based Strategies
Not on the map. Why?
Abstract (arXiv)
Continual learning remains a fundamental challenge in artificial intelligence, with catastrophic forgetting posing a significant barrier to deploying neural networks in dynamic environments. Inspired by biological memory consolidation mechanisms, we propose a novel framework for generative replay that leverages predictive coding principles to mitigate forgetting. We present a comprehensive comparison between predictive coding-based and backpropagation-based generative replay strategies, evaluating their effectiveness on task retention and transfer efficiency across multiple benchmark datasets. Our experimental results demonstrate that predictive coding-based replay achieves superior retention performance (average 15.3% improvement) while maintaining competitive transfer efficiency, suggesting that biologically-inspired mechanisms can offer principled solutions to continual learning challenges. The proposed framework provides insights into the relationship between biological memory processes and artificial learning systems, opening new avenues for neuroscience-inspired AI research.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 29 Nov 2025.
Builds on
10 of 19 references.
References · 10
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2016Progressive Neural Networkscited by 1,332
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2018Efficient Lifelong Learning with A-GEMcited by 1,044
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
- 2018Generative replay with feedback connections as a general strategy for continual learningcited by 103
- 2020Predictive Coding Approximates Backprop along Arbitrary Computation Graphscited by 89
Built on by
Not cited yet.