MEMTS: Internalizing Domain Knowledge via Parameterized Memory for Retrieval-Free Domain Adaptation of Time Series Foundation Models
Not on the map. Why?
Abstract (arXiv)
While Time Series Foundation Models (TSFMs) have demonstrated exceptional performance in generalized forecasting, their performance often degrades significantly when deployed in real-world vertical domains characterized by temporal distribution shifts and domain-specific periodic structures. Current solutions are primarily constrained by two paradigms: Domain-Adaptive Pretraining (DAPT), which improves short-term domain fitting but frequently disrupts previously learned global temporal patterns due to catastrophic forgetting; and Retrieval-Augmented Generation (RAG), which incorporates external knowledge but introduces substantial retrieval overhead. This creates a severe scalability bottleneck that fails to meet the high-efficiency requirements of real-time stream processing. To break this impasse, we propose Memory for Time Series (MEMTS), a lightweight and plug-and-play method for retrieval-free domain adaptation in time series forecasting. The key component of MEMTS is a Knowledge Persistence Module (KPM), which internalizes domain-specific temporal dynamics, such as recurring seasonal patterns and trends into a compact set of learnable latent prototypes. In doing so, it transforms fragmented historical observations into continuous, parameterized knowledge representations. This paradigm shift enables MEMTS to achieve accurate domain adaptation with constant-time inference and near-zero latency, while effectively mitigating catastrophic forgetting of general temporal patterns, all without requiring any architectural modifications to the frozen TSFM backbone. Extensive experiments on multiple datasets demonstrate the SOTA performance of MEMTS.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
29 of 60 references.
References · 29
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
- 2024Chronos: Learning the Language of Time Seriescited by 712
17 more
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
- 2022Transformers in Time Series: A Surveycited by 489
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
- 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 120
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
- 2025A Comprehensive Survey of Deep Learning for Multivariate Time Series Forecasting: A Channel Strategy Perspectivecited by 58
- 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 58
- 2025Rethinking Irregular Time Series Forecasting: A Simple yet Effective Baselinecited by 54
- 2024Retrieval Augmented Time Series Forecastingcited by 40
- 2025TS-RAG: Retrieval-Augmented Generation based Time Series Foundation Models are Stronger Zero-Shot Forecastercited by 36
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2020Deep Learning on Traffic Prediction: Methods, Analysis and Future Directionscited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026MemCast: Memory-Driven Time Series Forecasting with Experience-Conditioned Reasoning
- 2025Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs
- 2026Retrieval Is Not Enough: Refreshing Memory for Frozen Time-Series Forecasters
- 2026RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting
- 2026Semantics-Enhanced Retrieval-Augmented Time Series Forecasting
- 2026Channel-wise Retrieval for Multivariate Time Series Forecasting
- 2025QuiZSF: A Retrieval-Augmented Framework for Zero-Shot Time Series Forecasting
- 2026Factorize to Generalize: Retrieval-Guided Invariant-Dynamic Decomposition for Time Series Forecasting