mlsanityData to 14 Oct 2026

Spatial Context or Memory? Sizing the Inputs of Neural Surrogates for Partially Observed Fields

arXiv 2610.12723 ↗First posted 8 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural surrogates that forecast a physical field from sparse, noisy sensors read a window of nearby sensors and a history of past snapshots. Practitioners choose both by comparing fitted models with each other. Such comparisons cannot tell a model's shortfall from missing information. We measure the trade-off between window and history against the Bayes-optimal error of the same readings. An exact Gaussian analysis shows that noisy or sparse observation of a field with local dynamics makes the optimal forecast read distant sensors only through spatial correlation. On a forced linear field with a known optimum, trained models that read only the window come within 1% of it. We then train such models on viscous Burgers flow and the chaotic Kuramoto-Sivashinsky (KS) equation, with every deciding comparison fixed before any test evaluation. In every field except KS, eight snapshots remove a smaller fraction of the one-snapshot error as the lead time, the number of steps to the forecast target, grows. In KS, for windows up to one correlation length, they remove a larger fraction. This lead-time inversion persists across sensor densities, three architectures and a two-dimensional domain. It shrinks as damping lowers the Lyapunov exponent. Damping also removes the linear instability of KS. We therefore tie the inversion to instability and leave chaos and linear amplification unseparated. For surrogate design the results give two rules. Size the window in correlation lengths of the field. Split a fixed input budget between window and history for the lead time the model will serve, because the best split moves toward wider windows as the lead time grows. In Burgers flow the split chosen at lead time one ends with 13.5 times the best error at lead time eight.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 37 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

15 of 37 references.

References · 15

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
  3. 2019Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamicscited by 134
  4. 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
  5. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
  6. 2014Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical Datasetscited by 72
  7. 2024On the Benefits of Memory for Modeling Time-Dependent PDEscited by 31
  8. 2018Model Reduction with Memory and the Machine Learning of Dynamical Systemscited by 21
  9. 2019Sample Complexity of Kalman Filtering for Unknown Systemscited by 12
  10. 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference schemecited by 5
  11. 2025Merging Memory and Space: A State Space Neural Operatorcited by 2
  12. 2025FieldFormer: Locality-Aware Transformers for Spatio-Temporal Modeling on Sparse Sensor Networkscited by 1
3 more
  1. 2026Learning Neural Operators from Partial Observations via Latent Autoregressive Modelingcited by 1
  2. 2026System-Anchored Knee Estimation for Low-Cost Context Window Selection in PDE Forecastingcited by 1
  3. 2026How Much Memory Do We Need? Adaptive Memory Gate for Neural Operatorscited by 1

Built on by

Not cited yet.