mlsanityData to 14 Oct 2026

A Backpropagation-Free Feedback-Hebbian Network for Continual Learning Dynamics

arXiv 2601.06758 ↗First posted 11 Jan 2026cs.NE cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Feedback-rich neural architectures can regenerate earlier representations and inject temporal context, making them a natural setting for strictly local synaptic plasticity. Existing literature raises doubt about whether a minimal, backpropagation-free feedback-Hebbian system can already express interpretable continual-learning-relevant behaviors under controlled training schedules. In this work, we introduce a compact prediction-reconstruction architecture with a dedicated feedback pathway providing lightweight, locally trainable temporal context for continual adaptation. All synapses are updated by a unified local rule combining centered Hebbian covariance, Oja-style stabilization, and a local supervised drive where targets are available. With a simple two-pair association task, learning is characterized through layer-wise activity snapshots, connectivity trajectories (row and column means of learned weights), and a normalized retention index across phases. Under sequential A to B training, forward output connectivity exhibits a long-term depression (LTD)-like suppression of the earlier association, while feedback connectivity preserves an A-related trace during acquisition of B. Under an alternating sequence, both associations are concurrently maintained rather than sequentially suppressed. Architectural controls and rule-term ablations isolate the role of dedicated feedback in regeneration and co-maintenance, alongside the role of the local supervised term in output selectivity and unlearning. Together, the results show that a compact feedback pathway trained with local plasticity can support regeneration and continual-learning-relevant dynamics in a minimal, mechanistically transparent setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 14 references that are in the map. First posted on arXiv 11 Jan 2026.

Builds on

3 of 14 references.

References · 3

  1. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  2. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
  3. 2020A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learningcited by 87

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mastering Continual Reinforcement Learning through Fine-Grained Sparse Network Allocation and Dormant Neuron Exploration
  2. 2024Continual Learning with Neuromorphic Computing: Foundations, Methods, and Emerging Applications
  3. 2026Cortex-Inspired Continual Learning: Unsupervised Instantiation and Recovery of Functional Task Networks
  4. 2024Neuromimetic metaplasticity for adaptive continual learning
  5. 2026Brain-Inspired Hierarchical Modularity for General Continual Learning
  6. 2025Toward Lifelong Learning in Equilibrium Propagation: Sleep-like and Awake Rehearsal for Enhanced Stability
  7. 2022Learning Bayesian Sparse Networks with Full Experience Replay for Continual Learning
  8. 2025Activation Function Design Sustains Plasticity in Continual Learning