Self-Motivated Growing Neural Network for Adaptive Architecture via Local Structural Plasticity
Not on the map. Why?
Abstract (arXiv)
Control policies are often implemented with fixed-capacity multilayer perceptrons trained by backpropagation, which require architecture selection in advance and cannot adapt their capacity during learning. This paper introduces the Self-Motivated Growing Neural Network (SMGrNN), a gradient-trained controller whose topology evolves online through a local Structural Plasticity Module (SPM). The SPM monitors edge-wise weight update statistics over short temporal windows and uses these local signals to trigger neuron insertion and pruning, while synaptic weights are optimized by a standard gradient-based optimizer. This allows network capacity to be adjusted during learning without manual architectural tuning. SMGrNN is evaluated on control benchmarks via policy distillation. Compared with multilayer perceptron baselines, it achieves similar or higher returns, lower variance, and task-appropriate network sizes. Ablation studies with growth disabled and growth-only variants isolate the role of structural plasticity, showing that adaptive growth improves reward stability while pruning prevents uncontrolled expansion and supports compact network formation. These results establish the independent value of local structural plasticity within gradient-trained networks and motivate future investigation of whether similar structural rules can be extended to more local or spike-based learning settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 52 references that are in the map. First posted on arXiv 14 Dec 2025.
Builds on
20 of 52 references.
References · 20
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Progressive Neural Networkscited by 1,332
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2018Experience Replay for Continual Learningcited by 1,074
- 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
- 2018Progress & Compress: A scalable framework for continual learningcited by 516
- 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 262
- 2020A Neural Dirichlet Process Mixture Model for Task-Free Continual Learningcited by 133
- 2024Continual Learning and Catastrophic Forgettingcited by 73
- 2015Towards Biologically Plausible Deep Learningcited by 66
- 2023A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learningcited by 66
- 2022Hebbian Deep Learning Without Feedbackcited by 61
8 more
- 2019Complementary Learning for Overcoming Catastrophic Forgetting Using Experience Replaycited by 51
- 2016Neurogenesis Deep Learningcited by 32
- 2022HyperNCA: Growing Developmental Networks with Neural Cellular Automatacited by 18
- 2023Towards Self-Assembling Artificial Neural Networks through Neural Developmental Programscited by 17
- 2023Enhancing Efficient Continual Learning with Dynamic Structure Development of Spiking Neural Networkscited by 10
- 2024Evolving Self-Assembling Neural Networks: From Spontaneous Activity to Experience-Dependent Learningcited by 4
- 2021PyTorch-Hebbian: facilitating local learning in a deep learning frameworkcited by 2
- 2025Self-Controlled Dynamic Expansion Model for Continual Learningcited by 1
Built on by
Not cited yet.