mlsanityData to 14 Oct 2026

Instance-Adaptive Prompts as Context for Time-Series Foundation Models

arXiv 2609.34786 ↗First posted 28 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Longer histories can improve time-series foundation models (TSFMs), but require substantially higher inference cost. We therefore ask whether contextual information can be provided more efficiently through a compact set of learned token embeddings. We introduce PaCTS, which generates a small set of instance-adaptive latent prompts in the form of continuous embedding tokens conditioned on the visible context. These prompts serve as compact context surrogates for frozen TSFMs. PaCTS constructs them from instance-specific global statistics and further refines them with segment-level temporal information, capturing both global characteristics and local temporal variations. The prompt module is jointly trained and deployed across heterogeneous time series with the frozen backbone. Extensive experiments demonstrate the effectiveness of prompts as context, consistently improving forecasting across context lengths and model architectures. With a shorter input context, PaCTS can outperform the same frozen backbone using double context while requiring substantially less inference computation. Compared with weight-space adaptation methods, PaCTS achieves stronger improvements and better out-of-distribution generalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 51 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

45 of 51 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  7. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  9. 2022Visual Prompt Tuningcited by 1,681
  10. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  11. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  12. 2024Chronos: Learning the Language of Time Seriescited by 759
33 more
  1. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  2. 2023A decoder-only foundation model for time-series forecastingcited by 692
  3. 2022MaPLe: Multi-modal Prompt Learningcited by 687
  4. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  5. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  6. 2023Learning to Compress Prompts with Gist Tokenscited by 390
  7. 2023Adapting Language Models to Compress Contextscited by 356
  8. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 239
  9. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
  10. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  11. 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
  12. 2025TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learningcited by 120
  13. 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 69
  14. 2023Tuning LayerNorm in Attention: Towards Efficient Multi-Modal LLM Finetuningcited by 64
  15. 2024In-Context Fine-Tuning for Time-Series Foundation Modelscited by 35
  16. 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 33
  17. 2026Toto 2.0: Time Series Forecasting Enters the Scaling Eracited by 30
  18. 2026Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scalingcited by 28
  19. 2024Any-Shift Prompting for Generalization over Distributionscited by 24
  20. 2025Multi-Scale Finetuning for Encoder-based Time Series Foundation Modelscited by 14
  21. 2026Revisiting the Generic Transformer: Deconstructing a Strong Baseline for Time Series Foundation Modelscited by 12
  22. 2024Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Modelscited by 10
  23. 2025TimeHF: Billion-Scale Time Series Models Guided by Human Feedbackcited by 10
  24. 2025Xihe: Scalable Zero-Shot Time Series Learner Via Hierarchical Interleaved Block Attentioncited by 8
  25. 2024Generalized Prompt Tuning: Adapting Frozen Univariate Time Series Foundation Models for Multivariate Healthcare Time Seriescited by 5
  26. 2026TS-Memory: Plug-and-Play Memory for Time Series Foundation Modelscited by 5
  27. 2025TFMAdapter: Lightweight Instance-Level Adaptation of Foundation Models for Forecasting with Covariatescited by 3
  28. 2026TimeRFT: Stimulating Generalizable Time Series Forecasting for TSFMs via Reinforcement Finetuningcited by 3
  29. 2026Post-Training in Time Series Foundation Models: A Unifying Frameworkcited by 3
  30. 2026Foundation Models and Fine-Tuning: Toward a New Generation of Models for Time Series Forecastingcited by 2
  31. 2026Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Modelscited by 1
  32. 2026Compositional Spectral Prompts for LLM-based Online Time Series Forecastingcited by 1
  33. 2026Tabby: An Open Pretraining Recipe for Time Series Foundation Modelscited by 1

Built on by

Not cited yet.