Finite-Horizon Fisher Memory in Two-Sided Power-Bounded Recurrent Systems
Not on the map. Why?
Abstract (arXiv)
We analyse allocation, admission and post-write retention in finite-horizon linear-Gaussian noisy recurrent memories. At every horizon, the directional Fisher memory Mn satisfies operatornametrMn=N: non-normality redistributes information but cannot raise its spherical average, while normal carriers satisfy Mn=I. For bi-power-bounded carriers, we derive uniform 1/n lag bounds, identify the limit of Mn with the inverse of the classical Ces`aro asymptotic limit of W^top, and give finite-horizon error bounds. A time-varying coupling defines an end-to-end store operator. The writer-optimal direction need not be store-optimal. After writing ends, an invertible hold preserves the full stored Fisher matrix. Additive contamination bounded by α times the closure covariance retains at least 1/(1+α) of that matrix; a covariance-aware decoder attains the corresponding accuracy. With recurrent carriers held fixed, training input masks and linear readouts approached the task-specific optimum in 160 runs, with median normalized Rayleigh efficiency above 0.998. Binary accuracy matched the Gaussian prediction to mean absolute error below 0.002 over more than four orders of magnitude in J. In a separate pre-specified study of 320 runs, trained masks followed the designated input-time objective in both carrier types, in 16 of 16 draws. These studies used development-seen carriers and are pre-specified validations, not blind holdouts. The same fixed design reproduced the objective-specific result in 16 of 16 draws on carriers unused before run commitment. Exact isolation preserved information, while a decoder fixed at its training horizon fell to chance; inverse-adjoint transport restored its sampled decisions to numerical precision.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 52 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
17 of 52 references.
References · 17
- 2024Titans: Learning to Memorize at Test Timecited by 328
- 2024xLSTM: Extended Long Short-Term Memorycited by 327
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2019Recurrent Kalman Networks: Factorized Inference in High-Dimensional Deep Feature Spacescited by 67
- 2021UnICORNN: A recurrent model for learning very long time dependenciescited by 56
- 2019Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamicscited by 29
- 2020On the Curse of Memory in Recurrent Neural Networks: Approximation and Optimization Analysiscited by 27
- 2018Reversible Recurrent Neural Networkscited by 23
- 2019Improved memory in recurrent neural networks with sequential non-normal dynamicscited by 7
- 2013Covariance inflation in the ensemble Kalman filter: a residual nudging perspective and some implicationscited by 2
- 2016Robust information propagation through noisy neural circuitscited by 2
- 2024How noise affects memory in linear recurrent networkscited by 2
5 more
- 2019Efficient Communication over Complex Dynamical Networks: The Role of Matrix Non-Normalitycited by 1
- 2026Optimal Memory Encoding Through Fluctuation-Response Structurecited by 1
- 2026Memory Uncertainty Relation and Harmonic Memory in Random Recurrent Networkscited by 1
- 2026Lindblad-Inspired Multi-Timescale Reservoir Computing with Separable Rotation and Dissipationcited by 1
- 2026Universal Estimation of the Fisher Information for Processes with Memorycited by 1
Built on by
Not cited yet.