GRAM: Correcting Frozen Time-Series Foundation Models via Graph-Retrieved Amplitude Memory
Not on the map. Why?
Abstract (arXiv)
Time-series foundation models (TSFMs) enable zero-shot forecasting through large-scale cross-domain pretraining, while retrieval augmentation further improves their performance by leveraging historical information. However, existing methods typically correct TSFM forecasts using the ground-truth futures of similar historical windows, which contain both predictive components already captured by the foundation model and sample-specific random fluctuation that is difficult to transfer. In contrast, recurring systematic model bias within prediction errors more directly characterizes the failure modes of a frozen TSFM and therefore provides more valuable correction signals. Effectively exploiting such model bias, however, poses two challenges: prediction errors at different numerical levels are difficult to compare due to scale differences, and the recurring bias must be extracted from prediction errors contaminated by random fluctuation. To address these challenges, we propose GRAM, a general retrieval-augmented framework for frozen TSFMs. GRAM first introduces an Amplitude Memory Module (AMM) that scales prediction errors by amplitude and aggregates them into retrievable prototypes. It then employs a Prototype Graph Module (PGM) to model relations among prototypes to aggregate consistent bias information while suppressing random fluctuation. During online forecasting, GRAM retrieves and expands prototypes relevant to the current query and generates per-horizon corrections to refine the original TSFM forecast. Experiments across multiple datasets and foundation models demonstrate consistent forecasting improvements.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 49 of its 62 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
49 of 62 references.
References · 49
- 2017Attention Is All You Needcited by 60,106
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,797
- 2017Prototypical Networks for Few-shot Learningcited by 3,011
- 2017Billion-scale similarity search with GPUscited by 2,490
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,196
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,131
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,665
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
37 more
- 2021Improving language models by retrieving from trillions of tokenscited by 1,286
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,206
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,043
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,008
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 947
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 918
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 874
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 797
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 756
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 751
- 2024Chronos: Learning the Language of Time Seriescited by 737
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 693
- 2023A decoder-only foundation model for time-series forecastingcited by 674
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 623
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 602
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 497
- 2022Transformers in Time Series: A Surveycited by 493
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 468
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 389
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 341
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 286
- 2021Monash Time Series Forecasting Archivecited by 261
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 248
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 237
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 236
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 205
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 201
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 177
- 2023TimeGPT-1cited by 153
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 124
- 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 92
- 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 89
- 2024Retrieval Augmented Time Series Forecastingcited by 44
- 2025TS-RAG: Retrieval-Augmented Generation based Time Series Foundation Models are Stronger Zero-Shot Forecastercited by 38
- 2024TimeRAG: BOOSTING LLM Time Series Forecasting via Retrieval-Augmented Generationcited by 19
- 2024TimeRAF: Retrieval-Augmented Foundation model for Zero-shot Time Series Forecastingcited by 16
- 2026Stationarity-Aware Retrieval-Augmented Time Series Forecastingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Align-RAG: Alignment Is All You Need for TSFM In-Context Learning
- 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challenges
- 2026When, Not How Much: Evaluating Time-Series Foundation Models on Sparse Events
- 2026Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs
- 2026Aurora-X: Built for Extreme Time Series Forecasting
- 2026Retrieval Mechanisms Surpass Long-Context Scaling in Time Series Forecasting
- 2026Retrieval Is Not Enough: Refreshing Memory for Frozen Time-Series Forecasters
- 2026Factorize to Generalize: Retrieval-Guided Invariant-Dynamic Decomposition for Time Series Forecasting