Learning from History: A Retrieval-Augmented Framework for Spatiotemporal Prediction
Not on the map. Why?
Abstract (arXiv)
Accurate and long-term spatiotemporal prediction for complex physical systems remains a fundamental challenge in scientific computing. While deep learning models, as powerful parametric approximators, have shown remarkable success, they suffer from a critical limitation: the accumulation of errors during long-term autoregressive rollouts often leads to physically implausible artifacts. This deficiency arises from their purely parametric nature, which struggles to capture the full constraints of a system's intrinsic dynamics. To address this, we introduce a novel Retrieval-Augmented Prediction (RAP) framework, a hybrid paradigm that synergizes the predictive power of deep networks with the grounded truth of historical data. The core philosophy of RAP is to leverage historical evolutionary exemplars as a non-parametric estimate of the system's local dynamics. For any given state, RAP efficiently retrieves the most similar historical analog from a large-scale database. The true future evolution of this analog then serves as a reference target. Critically, this target is not a hard constraint in the loss function but rather a powerful conditional input to a specialized dual-stream architecture. It provides strong dynamic guidance, steering the model's predictions towards physically viable trajectories. In extensive benchmarks across meteorology, turbulence, and fire simulation, RAP not only surpasses state-of-the-art methods but also significantly outperforms a strong analog-only forecasting baseline. More importantly, RAP generates predictions that are more physically realistic by effectively suppressing error divergence in long-term rollouts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 32 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
20 of 32 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
8 more
- 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
- 2023MgNO: Efficient Parameterization of Linear Operators via Multigridcited by 40
- 2024Retrieval-Augmented Diffusion Models for Time Series Forecastingcited by 35
- 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 30
- 2023Earthfarseer: Versatile Spatio-Temporal Dynamical Systems Modeling in One Modelcited by 16
- 2025Turb-L1: Achieving Long-term Turbulence Tracing By Tackling Spectral Biascited by 9
- 2025Advanced Long-term Earth System Forecastingcited by 9
- 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Arbitrarily Conditioned Hierarchical Flows for Spatiotemporal Events
- 2026DiffUNet^2: Bidirectional Conditional Diffusion for Probabilistic Scientific Spatiotemporal Modeling
- 2025Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme
- 2026ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series
- 2026PIER: Physics-Informed Environmental Retrieval for Time-Series Modeling
- 2026GNA: Granular Neighbor Assembly for Retrieval-Augmented Multivariate Time-Series Forecasting
- 2026Memory in Deep Time-Series Models
- 2026Pythia: Toward Foundation World Models for Multimodal Time Series