mlsanityData to 7 Oct 2026

A Thermodynamic Theory of Learning Part II: History-Dependent Reachability and Continual Learning

arXiv 2602.07950 ↗First posted 8 Feb 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We formulate plasticity as target-dependent, finite-horizon reachability under history-dependent dynamics, using standard minimum-energy control theory. An extended state includes parameters and internal variables that affect future updates. Around a reference trajectory, the input-to-endpoint response and its controllability Gramian determine the minimum input energy for each reachable displacement. Minimizing this energy over the joint task target defines a task-conditioned adaptation cost, exact for the arbitrary-input linear model. A solvable learning-retention example shows that this cost can increase without any rank loss, and distinguishes small directional gain from an inaccessible direction. Wasserstein transport supplies a complementary global lower bound, while learning-map Jacobians describe deformation of initial perturbations rather than response to future inputs. The resulting learning-retention frontier depends on the current extended state, admissible updates, target, horizon, and cost metric; nonlinear and constrained-update applications require additional control of these modeling choices.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 12 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

5 of 12 references.

References · 5

  1. 2023Understanding plasticity in neural networkscited by 170
  2. 2025Mitigating Plasticity Loss in Continual Reinforcement Learning by Reducing Churncited by 22
  3. 2021Provable Continual Learning via Sketched Jacobian Approximationscited by 15
  4. 2025Gradient Descent as Loss Landscape Navigation: a Normative Framework for Deriving Learning Rulescited by 4
  5. 2023Keep Moving: identifying task-relevant subspaces to maximise plasticity for newly learned taskscited by 2

Built on by

Not cited yet.