mlsanityData to 14 Oct 2026

History, Adaptation, and Hidden Gain: Two Prospective Tests of Learned Predictive Control in a Synthetic Neural Population

arXiv 2610.14368 ↗First posted 9 Oct 2026cs.LG cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

We study learned one-step predictive control of a synthetic population of 64 leaky integrate-and-fire neurons whose light sensitivity is scaled by a hidden factor s, using two prospective confirmations on plants simulated only after the analysis was frozen. In the first (50 plants, 11 conditions), removing the 200-ms input-output history substantially worsened a parameter-count-matched neural predictor at low and moderate gain (s = 0.6, 0.8; RMSE rose by 2.47 Hz at s = 0.6, 97.5% CI 2.43-2.51). In secondary comparisons, recursively adapted ARX had the lowest mean error of the deployable controllers in 10 of 11 conditions, tuned PI with anti-windup matched or beat the network for s >= 0.7, and training for 10,000 rather than 900 epochs lowered prediction error but worsened control. Development work suggested the network's learned action sensitivity did not track the hidden gain. A second protocol (50 new plants, 9 sensitivities, 2 noise levels) confirmed three pre-specified predictions at the primary noise level. Re-estimating a single multiplicative input gain recovered 87% (95% CI 86-88%) of the benefit of full adaptive ARX. Supplying that online estimate to the network as an extra input reduced high-gain tracking error by 1.84 Hz [1.81, 1.88]. Longer training worsened the plain network by 1.09 Hz but improved the gain-input network by 1.07 Hz, a differential of 2.16 Hz [2.13, 2.20]. Under high process noise (sigma = 2.0) the effects shrank to about 0.04 Hz or less and gain-only adaptation recovered only 24% of the adaptive-ARX benefit. In this synthetic plant, at the primary noise level, one-parameter online gain estimation accounts for most of the gap between a history-based network and full adaptive ARX, and for its prediction-control mismatch.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 18 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

10 of 18 references.

References · 10

  1. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  2. 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
  3. 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 297
  4. 2017Preparing for the Unknown: Learning a Universal Policy with Online System Identificationcited by 141
  5. 2020Objective Mismatch in Model-based Reinforcement Learningcited by 96
  6. 2020The Value Equivalence Principle for Model-Based Reinforcement Learningcited by 94
  7. 2025Leveling the Playing Field: Carefully Comparing Classical and Learned Controllers for Quadrotor Trajectory Trackingcited by 6
  8. 2023Nonlinear Model Predictive Control of a Conductance-Based Neuron Model via Data-Driven Forecastingcited by 1
  9. 2024Model Predictive Control on the Neural Manifoldcited by 1
  10. 2026Learning Nonlinear Systems In-Context: From Synthetic Data to Real-World Motor Controlcited by 1

Built on by

Not cited yet.