mlsanityData to 13 Oct 2026

GRAM: Correcting Frozen Time-Series Foundation Models via Graph-Retrieved Amplitude Memory

arXiv 2610.04827 ↗First posted 4 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Time-series foundation models (TSFMs) enable zero-shot forecasting through large-scale cross-domain pretraining, while retrieval augmentation further improves their performance by leveraging historical information. However, existing methods typically correct TSFM forecasts using the ground-truth futures of similar historical windows, which contain both predictive components already captured by the foundation model and sample-specific random fluctuation that is difficult to transfer. In contrast, recurring systematic model bias within prediction errors more directly characterizes the failure modes of a frozen TSFM and therefore provides more valuable correction signals. Effectively exploiting such model bias, however, poses two challenges: prediction errors at different numerical levels are difficult to compare due to scale differences, and the recurring bias must be extracted from prediction errors contaminated by random fluctuation. To address these challenges, we propose GRAM, a general retrieval-augmented framework for frozen TSFMs. GRAM first introduces an Amplitude Memory Module (AMM) that scales prediction errors by amplitude and aggregates them into retrievable prototypes. It then employs a Prototype Graph Module (PGM) to model relations among prototypes to aggregate consistent bias information while suppressing random fluctuation. During online forecasting, GRAM retrieves and expands prototypes relevant to the current query and generates per-horizon corrections to refine the original TSFM forecast. Experiments across multiple datasets and foundation models demonstrate consistent forecasting improvements.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 49 of its 62 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

49 of 62 references.

References · 49

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,221
  3. 2017On Calibration of Modern Neural Networkscited by 4,902
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,797
  5. 2017Prototypical Networks for Few-shot Learningcited by 3,011
  6. 2017Billion-scale similarity search with GPUscited by 2,490
  7. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,196
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
  9. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,131
  10. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
  11. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,665
  12. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
37 more
  1. 2021Improving language models by retrieving from trillions of tokenscited by 1,286
  2. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,206
  3. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,043
  4. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,008
  5. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 947
  6. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 918
  7. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 874
  8. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 797
  9. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 756
  10. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 751
  11. 2024Chronos: Learning the Language of Time Seriescited by 737
  12. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 693
  13. 2023A decoder-only foundation model for time-series forecastingcited by 674
  14. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 623
  15. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 602
  16. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 497
  17. 2022Transformers in Time Series: A Surveycited by 493
  18. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 468
  19. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 389
  20. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 341
  21. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 286
  22. 2021Monash Time Series Forecasting Archivecited by 261
  23. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 248
  24. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 237
  25. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 236
  26. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 205
  27. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 201
  28. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 177
  29. 2023TimeGPT-1cited by 153
  30. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 124
  31. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 92
  32. 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 89
  33. 2024Retrieval Augmented Time Series Forecastingcited by 44
  34. 2025TS-RAG: Retrieval-Augmented Generation based Time Series Foundation Models are Stronger Zero-Shot Forecastercited by 38
  35. 2024TimeRAG: BOOSTING LLM Time Series Forecasting via Retrieval-Augmented Generationcited by 19
  36. 2024TimeRAF: Retrieval-Augmented Foundation model for Zero-shot Time Series Forecastingcited by 16
  37. 2026Stationarity-Aware Retrieval-Augmented Time Series Forecastingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Align-RAG: Alignment Is All You Need for TSFM In-Context Learning
  2. 2025Rethinking Evaluation in the Era of Time Series Foundation Models: (Un)known Information Leakage Challenges
  3. 2026When, Not How Much: Evaluating Time-Series Foundation Models on Sparse Events
  4. 2026Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs
  5. 2026Aurora-X: Built for Extreme Time Series Forecasting
  6. 2026Retrieval Mechanisms Surpass Long-Context Scaling in Time Series Forecasting
  7. 2026Retrieval Is Not Enough: Refreshing Memory for Frozen Time-Series Forecasters
  8. 2026Factorize to Generalize: Retrieval-Guided Invariant-Dynamic Decomposition for Time Series Forecasting