mlsanityData to 14 Oct 2026

Intrinsic-Noise Consolidation: A Doob-Barrier-Conditioned Diffusion Turns Analog Device Noise into a Continual-Learning Resource

arXiv 2607.06924 ↗First posted 8 Jul 2026cs.LG cs.NEcited by 1

Not on the map. Why?

Abstract (arXiv)

On analog neuromorphic hardware, intrinsic device noise is normally an accuracy tax. We ask whether it can instead consolidate memories. We cast per-synapse consolidation as a Doob h-transform: condition each weight's stochastic dynamics on never crossing a memory-critical barrier around its consolidated value. The conditioned diffusion gains an extra drift sigma^2 d/dw log h, a restoring force amplified by the noise variance itself that diverges at the barrier. We are explicit about novelty: the anchored drift -s(w-mu) our rule also contains is not ours (the limit of OUA, MESU, and EWC), and we surrender it. We claim only the conjunction of (a) the Doob barrier-conditioning as a synaptic rule, to our knowledge unclaimed (every h-transform use we found is generative modeling, none synaptic), and (b) a falsifiable prediction: increasing intrinsic noise non-monotonically improves sequential-task retention, an inverted-U that anchored-drift methods cannot produce. We pre-registered this as a go/no-go gate; it passes. On single-head Split-MNIST (8 seeds) the rule lifts retention 10.9 points at an interior optimum (paired Wilcoxon p=0.004), while matched OU/EWC/MESU anchors are monotone. Ablating the conditioning removes the effect; the optimum tracks the barrier; the inverted-U survives a second task stream and the realization where noise enters the forward pass. We then measure the intrinsic noise on real BrainScaleS-2 silicon (additive, trial-to-trial independent, tunable via on-chip averaging) and run the rule on the chip with its noise in the training loop: barrier-conditioning retains a prior task 15.6 points better than the matched control at matched average accuracy, a stability-plasticity shift, not a net-accuracy win (single seed; retention measured, energy modelled). Intrinsic analog noise thus becomes a consolidation dividend a digital accelerator must spend energy to generate.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

12 of 18 references.

References · 12

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  2. 2021Simulating Diffusion Bridges with Score Matchingcited by 52
  3. 2020Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic Forgettingcited by 28
  4. 2024Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Samplingcited by 27
  5. 2025h-Edit: Effective and Flexible Diffusion-Based Editing via Doob's h-Transformcited by 19
  6. 2024Reflected Schr"odinger Bridge for Constrained Generative Modelingcited by 12
  7. 2025Bayesian continual learning and forgetting in neural networkscited by 9
  8. 2024Ornstein-Uhlenbeck Adaptation as a Mechanism for Learning in Brains and Machinescited by 6
  9. 2024Noise-Aware Training of Neuromorphic Dynamic Device Networkscited by 5
  10. 2020Inference with Artificial Neural Networks on Analog Neuromorphic Hardwarecited by 4
  11. 2024Probabilistic Metaplasticity for Continual Learning with Memristorscited by 1
  12. 2025Internal noise in hardware deep and recurrent neural networks helps with learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.