mlsanityData to 7 Oct 2026

Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey

arXiv 2405.02358 ↗First posted 3 May 2024cs.LG cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent years, foundation models have revolutionized NLP and CV with their remarkable cross-task transferability, zero-/few-shot learning capabilities, and multimodal integration capacity. This success has motivated increasing efforts to explore foundation models for addressing time series modeling challenges. Although some tutorials and surveys were published in the early stages of this field, the rapid pace of recent developments necessitates a more comprehensive and in-depth synthesis to cover the latest advances. Our survey aims to fill this gap by introducing a modality-aware, challenge-oriented perspective, which reveals how foundation models pre-trained on different modalities face distinct hurdles when adapted to time series tasks. Building on this perspective, we propose a taxonomy of existing works organized by pre-training modality (time series, language, and vision), analyze modality-specific challenges and categorize corresponding solutions, discussing their advantages and limitations. Beyond this, we review real-world applications to illustrate domain-specific advancements, provide open-source codes, and conclude with potential future research directions in this rapidly evolving field.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 77 of its 191 references that are in the map. First posted on arXiv 3 May 2024.

Builds on

77 of 191 references.

References · 77

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  9. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  10. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  11. 2023Visual Instruction Tuningcited by 7,792
  12. 2020Measuring Massive Multitask Language Understandingcited by 7,768
38 more
  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2022Emergent Abilities of Large Language Modelscited by 2,483
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  8. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  9. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  11. 2024Chronos: Learning the Language of Time Seriescited by 712
  12. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  13. 2023A decoder-only foundation model for time-series forecastingcited by 650
  14. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  15. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  16. 2018Deep learning for time series classification: a reviewcited by 575
  17. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  18. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  19. 2022Transformers in Time Series: A Surveycited by 489
  20. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  21. 2018The UCR Time Series Archivecited by 421
  22. 2018The UEA multivariate time series classification archive, 2018cited by 330
  23. 2023ClimaX: A foundation model for weather and climatecited by 325
  24. 2021Monash Time Series Forecasting Archivecited by 256
  25. 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
  26. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
  27. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
  28. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
  29. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
  30. 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
  31. 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 125
  32. 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
  33. 2023Large Language Models are Few-Shot Health Learnerscited by 115
  34. 2024Large Language Models for Time Series: A Surveycited by 113
  35. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
  36. 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 105
  37. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
  38. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 10; 2026: 7.

23 papers.

Sort:

By area:

  1. 2025Performance of Zero-Shot Time Series Foundation Models on Cloud Datacited by 10
  2. 2024Repurposing Foundation Model for Generalizable Medical Time Series Classificationcited by 6
  3. 2024Generalized Prompt Tuning: Adapting Frozen Univariate Time Series Foundation Models for Multivariate Healthcare Time Seriescited by 5
  4. 2024FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modelingcited by 4
  5. 2024Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglementcited by 4
  6. 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challengescited by 2
  7. 2025The language of time: a language model perspective on time-series foundation modelscited by 2
  8. 2026ChronosAD: Leveraging Time Series Foundation Models for Accurate Anomaly Detectioncited by 2
  9. 2025The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysiscited by 1
  10. 2026Can LLM Coding Agents Reason About Time Series?cited by 1
  11. 2026Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Modelscited by 1
  12. 2024FlexTSF: A Flexible Forecasting Model for Time Series with Variable Regularitiescited by 0
11 more
  1. 2024Fine-Tuning Pre-trained Large Time Series Models for Prediction of Wind Turbine SCADA Datacited by 0
  2. 2025Evaluating Time Series Foundation Models on Noisy Periodic Time Seriescited by 0
  3. 2025LeForecast: Enterprise Hybrid Forecast by Time Series Intelligencecited by 0
  4. 2025Feature Fitted Online Conformal Prediction for Deep Time Series Forecasting Modelcited by 0
  5. 2025Gradient Flow Matching for Learning Update Dynamics in Neural Network Trainingcited by 0
  6. 2025ss-Mamba: Semantic-Spline Selective State-Space Modelcited by 0
  7. 2025Evaluation of Stress Detection as Time Series Events -- A Novel Window-Based F1-Metriccited by 0
  8. 2026SignalMC-MED: A Multimodal Benchmark for Evaluating Biosignal Foundation Models on Single-Lead ECG and PPGcited by 0
  9. 2026ARTEMIS: A Neuro Symbolic Framework for Economically Constrained Market Dynamicscited by 0
  10. 2026Model-agnostic Retrieval-Augmented Extended Forecasting for time seriescited by 0
  11. 2026Parameter-Efficient Adaptation of Pretrained Language Models for Time-Series Forecastingcited by 0