A Thermodynamic Theory of Learning Part II: History-Dependent Reachability and Continual Learning
Not on the map. Why?
Abstract (arXiv)
We formulate plasticity as target-dependent, finite-horizon reachability under history-dependent dynamics, using standard minimum-energy control theory. An extended state includes parameters and internal variables that affect future updates. Around a reference trajectory, the input-to-endpoint response and its controllability Gramian determine the minimum input energy for each reachable displacement. Minimizing this energy over the joint task target defines a task-conditioned adaptation cost, exact for the arbitrary-input linear model. A solvable learning-retention example shows that this cost can increase without any rank loss, and distinguishes small directional gain from an inaccessible direction. Wasserstein transport supplies a complementary global lower bound, while learning-map Jacobians describe deformation of initial perturbations rather than response to future inputs. The resulting learning-retention frontier depends on the current extended state, admissible updates, target, horizon, and cost metric; nonlinear and constrained-update applications require additional control of these modeling choices.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 12 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
5 of 12 references.
References · 5
- 2023Understanding plasticity in neural networkscited by 170
- 2025Mitigating Plasticity Loss in Continual Reinforcement Learning by Reducing Churncited by 22
- 2021Provable Continual Learning via Sketched Jacobian Approximationscited by 15
- 2025Gradient Descent as Loss Landscape Navigation: a Normative Framework for Deriving Learning Rulescited by 4
- 2023Keep Moving: identifying task-relevant subspaces to maximise plasticity for newly learned taskscited by 2
Built on by
Not cited yet.