mlsanityData to 13 Oct 2026

NeuroPlastic: A Plasticity-Modulated Optimizer for Biologically Inspired Learning Dynamics

arXiv 2604.26297 ↗First posted 29 Apr 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Optimization algorithms are fundamental to modern deep learning, yet most widely used methods rely on update rules based primarily on local gradient statistics. We introduce NeuroPlastic, a plasticity-modulated optimizer that augments gradient-based updates with an adaptive multi-signal modulation mechanism inspired by multi-factor synaptic plasticity, a concept from neurobiology. NeuroPlastic dynamically scales gradient updates using interacting components that capture gradient, activity-like, and memory-like statistics, forming a lightweight modulation layer compatible with standard deep learning training pipelines. Across image classification benchmarks, NeuroPlastic consistently improves over a controlled gradient-only ablation, with more pronounced gains on the Fashion-MNIST benchmark and in reduced-data regimes. In transfer experiments on CIFAR-10 with ResNet-18, the method remains stable and competitive without retuning. These results suggest that multi-signal plasticity-inspired modulation can provide a useful extension to conventional gradient-driven optimization, particularly when learning signals are limited or noisy, and offer a promising direction for gradient-based methods in deep learning.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

18 of 37 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2020Language Models are Few-Shot Learnerscited by 32,320
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,328
  5. 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 787
  6. 2016Learning to learn by gradient descent by gradient descentcited by 617
  7. 2023Symbolic Discovery of Optimization Algorithmscited by 425
  8. 2018Shampoo: Preconditioned Stochastic Tensor Optimizationcited by 420
  9. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  10. 2014Difference Target Propagationcited by 146
  11. 2018Differentiable plasticity: training plastic neural networks with backpropagationcited by 84
  12. 2020Learning with Differentiable Perturbed Optimizerscited by 81
6 more
  1. 2016Towards an integration of deep learning and neurosciencecited by 77
  2. 2018Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rulescited by 64
  3. 2020A Theoretical Framework for Target Propagationcited by 57
  4. 2023Kronecker-Factored Approximate Curvature for Modern Neural Network Architecturescited by 49
  5. 2020Backpropamine: training self-modifying neural networks with differentiable neuromodulated plasticitycited by 41
  6. 2022Efficient Non-Parametric Optimizer Search for Diverse Taskscited by 6

Built on by

Not cited yet.