Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource
Not on the map. Why?
Abstract (arXiv)
On analog neuromorphic hardware, intrinsic device noise is normally an accuracy tax. We ask whether it can instead consolidate memories. We cast per-synapse consolidation as a Doob h-transform: condition each weight's stochastic dynamics on never crossing a memory-critical barrier around its consolidated value. The conditioned diffusion gains an extra drift sigma^2 d/dw log h, a restoring force amplified by the noise variance itself that diverges at the barrier. We are explicit about novelty: the anchored drift -s(w-mu) our rule also contains is not ours (the limit of OUA, MESU, and EWC), and we surrender it. We claim only the conjunction of (a) the Doob barrier-conditioning as a synaptic rule, to our knowledge unclaimed (every h-transform use we found is generative modeling, none synaptic), and (b) a falsifiable prediction: increasing intrinsic noise non-monotonically improves sequential-task retention, an inverted-U that anchored-drift methods cannot produce. We pre-registered this as a go/no-go gate; it passes. On single-head Split-MNIST (8 seeds) the rule lifts retention 10.9 points at an interior optimum (paired Wilcoxon p=0.004), while matched OU/EWC/MESU anchors are monotone. Ablating the conditioning removes the effect; the optimum tracks the barrier; the inverted-U survives a second task stream and the realization where noise enters the forward pass. We then measure the intrinsic noise on real BrainScaleS-2 silicon (additive, trial-to-trial independent, tunable via on-chip averaging) and run the rule on the chip with its noise in the training loop: barrier-conditioning retains a prior task 15.6 points better than the matched control at matched average accuracy, a stability-plasticity shift, not a net-accuracy win (single seed; retention measured, energy modelled). Intrinsic analog noise thus becomes a consolidation dividend a digital accelerator must spend energy to generate.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
12 of 18 references.
References · 12
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2021Simulating Diffusion Bridges with Score Matchingcited by 52
- 2020Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic Forgettingcited by 28
- 2024Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Samplingcited by 27
- 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transformcited by 19
- 2024Reflected Schr"odinger Bridge for Constrained Generative Modelingcited by 12
- 2025Bayesian continual learning and forgetting in neural networkscited by 9
- 2024Ornstein-Uhlenbeck Adaptation as a Mechanism for Learning in Brains and Machinescited by 6
- 2024Noise-Aware Training of Neuromorphic Dynamic Device Networkscited by 5
- 2020Inference with Artificial Neural Networks on Analog Neuromorphic Hardwarecited by 4
- 2024Probabilistic Metaplasticity for Continual Learning with Memristorscited by 1
- 2025Internal noise in hardware deep and recurrent neural networks helps with learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.