Between Amnesia and Chaos: A Memory Stability Expressivity Trilemma for Trainable Dissipative Oscillator Networks
Not on the map. Why?
Abstract (arXiv)
Physical reservoir computing harnesses nonlinear mechanical dynamics but, by convention, freezes the substrate and trains only a linear readout, presuming the substrate is not usefully trainable. We revisit that premise for networks of nonlinear oscillators whose mass, damping, and stiffness are learned end-to-end through a symplectic integrator. Our central result is a trilemma: memory horizon, gradient stability, and dynamical expressivity cannot be simultaneously maximized, because all three are governed by the damping. The backward gradient decays at a rate set by the damping, capping how far back credit can propagate, while forward sensitivities grow exponentially in the largest Lyapunov exponent, so usable gradients require damping above a stability floor. Since the Lyapunov exponent falls as damping rises while the memory ceiling falls as the horizon grows, stable training is confined to a band that contracts with horizon and closes at a critical point. We test every step on a twenty-oscillator network. A damping sweep finds the largest Lyapunov exponent monotone and crossing zero at a well-defined stability floor, confirming the theorem's key assumption. A compute-matched comparison of learned versus frozen substrate on delayed recall across nine horizons shows the learned substrate dominating at short horizons and the advantage closing and reversing near a horizon of eleven steps, the predicted signature of band closure; trained models settle near the stability floor, seeking the edge of chaos unprompted. The analytic ceiling overestimates the empirical crossover roughly fivefold, a gap between detectable and learnable gradient that we report rather than tune away. The contribution is a confirmed account of when training a physical substrate beats freezing it.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 8 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
6 of 8 references.
References · 6
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2019Hamiltonian Neural Networkscited by 712
- 2020Lagrangian Neural Networkscited by 398
- 2020Physical reservoir computing -- An introductory perspectivecited by 58
Built on by
Not cited yet.