mlsanityData to 7 Oct 2026

Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction

arXiv 2510.24049 ↗First posted 28 Oct 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurate and long-term spatiotemporal prediction for complex physical systems remains a fundamental challenge in scientific computing. While deep learning models, as powerful parametric approximators, have shown remarkable success, they suffer from a critical limitation: the accumulation of errors during long-term autoregressive rollouts often leads to physically implausible artifacts. This deficiency arises from their purely parametric nature, which struggles to capture the full constraints of a system's intrinsic dynamics. To address this, we introduce a novel Retrieval-Augmented Prediction (RAP) framework, a hybrid paradigm that synergizes the predictive power of deep networks with the grounded truth of historical data. The core philosophy of RAP is to leverage historical evolutionary exemplars as a non-parametric estimate of the system's local dynamics. For any given state, RAP efficiently retrieves the most similar historical analog from a large-scale database. The true future evolution of this analog then serves as a reference target. Critically, this target is not a hard constraint in the loss function but rather a powerful conditional input to a specialized dual-stream architecture. It provides strong dynamic guidance, steering the model's predictions towards physically viable trajectories. In extensive benchmarks across meteorology, turbulence, and fire simulation, RAP not only surpasses state-of-the-art methods but also significantly outperforms a strong analog-only forecasting baseline. More importantly, RAP generates predictions that are more physically realistic by effectively suppressing error divergence in long-term rollouts.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

20 of 32 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  6. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  7. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  8. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  9. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  10. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  11. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  12. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
8 more
  1. 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
  2. 2023MgNO: Efficient Parameterization of Linear Operators via Multigridcited by 40
  3. 2024Retrieval-Augmented Diffusion Models for Time Series Forecastingcited by 35
  4. 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 30
  5. 2023Earthfarseer: Versatile Spatio-Temporal Dynamical Systems Modeling in One Modelcited by 16
  6. 2025Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Biascited by 9
  7. 2025Advanced Long-term Earth System Forecastingcited by 9
  8. 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Arbitrarily Conditioned Hierarchical Flows for Spatiotemporal Events
  2. 2026DiffUNet^2: Bidirectional Conditional Diffusion for Probabilistic Scientific Spatiotemporal Modeling
  3. 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme
  4. 2026ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series
  5. 2026PIER: Physics-Informed Environmental Retrieval for Time-Series Modeling
  6. 2026GNA: Granular Neighbor Assembly for Retrieval-Augmented Multivariate Time-Series Forecasting
  7. 2026Memory in Deep Time-Series Models
  8. 2026Pythia: Toward Foundation World Models for Multimodal Time Series