mlsanityData to 7 Oct 2026

MEMTS: Internalizing Domain Knowledge via Parameterized Memory for Retrieval-Free Domain Adaptation of Time Series Foundation Models

arXiv 2602.13783 ↗First posted 14 Feb 2026cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

While Time Series Foundation Models (TSFMs) have demonstrated exceptional performance in generalized forecasting, their performance often degrades significantly when deployed in real-world vertical domains characterized by temporal distribution shifts and domain-specific periodic structures. Current solutions are primarily constrained by two paradigms: Domain-Adaptive Pretraining (DAPT), which improves short-term domain fitting but frequently disrupts previously learned global temporal patterns due to catastrophic forgetting; and Retrieval-Augmented Generation (RAG), which incorporates external knowledge but introduces substantial retrieval overhead. This creates a severe scalability bottleneck that fails to meet the high-efficiency requirements of real-time stream processing. To break this impasse, we propose Memory for Time Series (MEMTS), a lightweight and plug-and-play method for retrieval-free domain adaptation in time series forecasting. The key component of MEMTS is a Knowledge Persistence Module (KPM), which internalizes domain-specific temporal dynamics, such as recurring seasonal patterns and trends into a compact set of learnable latent prototypes. In doing so, it transforms fragmented historical observations into continuous, parameterized knowledge representations. This paradigm shift enables MEMTS to achieve accurate domain adaptation with constant-time inference and near-zero latency, while effectively mitigating catastrophic forgetting of general temporal patterns, all without requiring any architectural modifications to the frozen TSFM backbone. Extensive experiments on multiple datasets demonstrate the SOTA performance of MEMTS.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

29 of 60 references.

References · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  8. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  9. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  10. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  11. 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
  12. 2024Chronos: Learning the Language of Time Seriescited by 712
17 more
  1. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  2. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
  3. 2022Transformers in Time Series: A Surveycited by 489
  4. 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
  5. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  6. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  7. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
  8. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 120
  9. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  10. 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
  11. 2025A Comprehensive Survey of Deep Learning for Multivariate Time Series Forecasting: A Channel Strategy Perspectivecited by 58
  12. 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 58
  13. 2025Rethinking Irregular Time Series Forecasting: A Simple yet Effective Baselinecited by 54
  14. 2024Retrieval Augmented Time Series Forecastingcited by 40
  15. 2025TS-RAG: Retrieval-Augmented Generation based Time Series Foundation Models are Stronger Zero-Shot Forecastercited by 36
  16. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  17. 2020Deep Learning on Traffic Prediction: Methods, Analysis and Future Directionscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemCast: Memory-Driven Time Series Forecasting with Experience-Conditioned Reasoning
  2. 2025Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs
  3. 2026Retrieval Is Not Enough: Refreshing Memory for Frozen Time-Series Forecasters
  4. 2026RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting
  5. 2026Semantics-Enhanced Retrieval-Augmented Time Series Forecasting
  6. 2026Channel-wise Retrieval for Multivariate Time Series Forecasting
  7. 2025QuiZSF: A Retrieval-Augmented Framework for Zero-Shot Time Series Forecasting
  8. 2026Factorize to Generalize: Retrieval-Guided Invariant-Dynamic Decomposition for Time Series Forecasting