mlsanityData to 7 Oct 2026

Post-Training in Time Series Foundation Models: A Unifying Framework

arXiv 2607.20002 ↗First posted 22 Jul 2026cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Time series foundation models (TSFMs) have emerged as general-purpose models for time series analysis, but pretraining alone is often insufficient for reliable downstream deployment. Bridging this gap requires further intervention to handle domain shift, task heterogeneity, limited supervision, and computational constraints, which motivates post-training as a broad class of methods to adapt, augment, compose, calibrate, or specialize pretrained TSFMs for downstream tasks. In this work, we analyze TSFM post-training methods based on their locus of intervention in the prediction pipeline, yielding five categories: parameter adaptation, context augmentation, model composition, output processing and uncertainty control, and compression and specialization. Within each category, we study main representative methods and discuss their current limitations. We further identify future directions toward controlled adaptation, reliable context construction, uncertainty-aware model composition, calibrated output processing, and deployment-aware specialization. Overall, by providing a unifying framework for the emerging TSFM post-training landscape, this work aims to support future research to navigate the design space between a pretrained TSFM and its reliable downstream deployment.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 127 of its 169 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

127 of 169 references.

References · 127

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2022Training language models to follow instructions with human feedbackcited by 15,712
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  8. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  9. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  10. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  11. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  12. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
38 more
  1. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  2. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  4. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  5. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  7. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,291
  8. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  9. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  10. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  12. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,104
  13. 2023LIMA: Less Is More for Alignmentcited by 1,080
  14. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  15. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  16. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  17. 2025SAM 3: Segment Anything with Conceptscited by 835
  18. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  19. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  20. 2024Chronos: Learning the Language of Time Seriescited by 712
  21. 2023A decoder-only foundation model for time-series forecastingcited by 650
  22. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  23. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
  24. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  25. 2018The UCR Time Series Archivecited by 421
  26. 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
  27. 2018The UEA multivariate time series classification archive, 2018cited by 330
  28. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
  29. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 188
  30. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  31. 2023TimeGPT-1cited by 149
  32. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
  33. 2023DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detectioncited by 103
  34. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
  35. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
  36. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
  37. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 88
  38. 2024Context is Key: A Benchmark for Forecasting with Essential Textual Informationcited by 78

50 most cited of 127 All 127 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.