A Backpropagation-Free Feedback-Hebbian Network for Continual Learning Dynamics
Not on the map. Why?
Abstract (arXiv)
Feedback-rich neural architectures can regenerate earlier representations and inject temporal context, making them a natural setting for strictly local synaptic plasticity. Existing literature raises doubt about whether a minimal, backpropagation-free feedback-Hebbian system can already express interpretable continual-learning-relevant behaviors under controlled training schedules. In this work, we introduce a compact prediction-reconstruction architecture with a dedicated feedback pathway providing lightweight, locally trainable temporal context for continual adaptation. All synapses are updated by a unified local rule combining centered Hebbian covariance, Oja-style stabilization, and a local supervised drive where targets are available. With a simple two-pair association task, learning is characterized through layer-wise activity snapshots, connectivity trajectories (row and column means of learned weights), and a normalized retention index across phases. Under sequential A to B training, forward output connectivity exhibits a long-term depression (LTD)-like suppression of the earlier association, while feedback connectivity preserves an A-related trace during acquisition of B. Under an alternating sequence, both associations are concurrently maintained rather than sequentially suppressed. Architectural controls and rule-term ablations isolate the role of dedicated feedback in regeneration and co-maintenance, alongside the role of the local supervised term in output selectivity and unlearning. Together, the results show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning-relevant dynamics in a minimal, mechanistically transparent setting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 14 references that are in the map. First posted on arXiv 11 Jan 2026.
Builds on
3 of 14 references.
References · 3
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
- 2020A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learningcited by 87
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Mastering Continual Reinforcement Learning through Fine-Grained Sparse Network Allocation and Dormant Neuron Exploration
- 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applications
- 2026Cortex-Inspired Continual Learning: Unsupervised Instantiation and Recovery of Functional Task Networks
- 2024Neuromimetic metaplasticity for adaptive continual learning
- 2026Brain-Inspired Hierarchical Modularity for General Continual Learning
- 2025Toward Lifelong Learning in Equilibrium Propagation: Sleep-like and Awake Rehearsal for Enhanced Stability
- 2022Learning Bayesian Sparse Networks with Full Experience Replay for Continual Learning
- 2025Activation Function Design Sustains Plasticity in Continual Learning