mlsanityData to 7 Oct 2026

Information as Structural Alignment: A Dynamical Theory of Continual Learning

arXiv 2604.07108 ↗First posted 8 Apr 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Catastrophic forgetting is not an engineering failure. It is a mathematical consequence of storing knowledge as global parameter superposition. Existing methods, such as regularization, replay, and frozen subnetworks, add external mechanisms to a shared-parameter substrate. None derives retention from the learning dynamics themselves. This paper introduces the Informational Buildup Framework (IBF), an alternative substrate for continual learning, based on the premise that information is the achievement of structural alignment rather than stored content. In IBF, two equations govern the dynamics: a Law of Motion that drives configuration toward higher coherence, and Modification Dynamics that persistently deform the coherence landscape in response to localized discrepancies. Memory, agency, and self-correction arise from these dynamics rather than being added as separate modules. We first demonstrate the full lifecycle in a transparent two-dimensional toy model, then validate across three domains: a controlled non-stationary world, chess evaluated independently by Stockfish, and Split-CIFAR-100 with a frozen ViT encoder. Across all three, IBF achieves replay-superior retention without storing raw data. We observe near-zero forgetting on CIFAR-100 (BT = -0.004), positive backward transfer in chess (+38.5 cp), and 43% less forgetting than replay in the controlled domain. In chess, the framework achieves a mean behavioral advantage of +88.9 +/- 2.8 cp under independent evaluation, exceeding MLP and replay baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

9 of 23 references.

References · 9

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  2. 2016Progressive Neural Networkscited by 1,332
  3. 2017Lifelong Learning with Dynamically Expandable Networkscited by 689
  4. 2017Neural Episodic Controlcited by 148
  5. 2019Functional Regularisation for Continual Learning with Gaussian Processescited by 121
  6. 2018Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilizationcited by 104
  7. 2020Continual Deep Learning by Functional Regularisation of Memorable Pastcited by 104
  8. 2016Model-Free Episodic Controlcited by 100
  9. 2021Kernel Continual Learningcited by 27

Built on by

Not cited yet.