Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent years, foundation models have revolutionized NLP and CV with their remarkable cross-task transferability, zero-/few-shot learning capabilities, and multimodal integration capacity. This success has motivated increasing efforts to explore foundation models for addressing time series modeling challenges. Although some tutorials and surveys were published in the early stages of this field, the rapid pace of recent developments necessitates a more comprehensive and in-depth synthesis to cover the latest advances. Our survey aims to fill this gap by introducing a modality-aware, challenge-oriented perspective, which reveals how foundation models pre-trained on different modalities face distinct hurdles when adapted to time series tasks. Building on this perspective, we propose a taxonomy of existing works organized by pre-training modality (time series, language, and vision), analyze modality-specific challenges and categorize corresponding solutions, discussing their advantages and limitations. Beyond this, we review real-world applications to illustrate domain-specific advancements, provide open-source codes, and conclude with potential future research directions in this rapidly evolving field.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 77 of its 191 references that are in the map. First posted on arXiv 3 May 2024.
Builds on
77 of 191 references.
References · 77
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023Visual Instruction Tuningcited by 7,792
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
38 more
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2018Deep learning for time series classification: a reviewcited by 575
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2022Transformers in Time Series: A Surveycited by 489
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2018The UCR Time Series Archivecited by 421
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2023ClimaX: A foundation model for weather and climatecited by 325
- 2021Monash Time Series Forecasting Archivecited by 256
- 2024Foundation Models for Time Series Analysis: A Tutorial and Surveycited by 234
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
- 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 165
- 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 139
- 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 125
- 2024Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Seriescited by 120
- 2023Large Language Models are Few-Shot Health Learnerscited by 115
- 2024Large Language Models for Time Series: A Surveycited by 113
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
- 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 105
- 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 102
- 2024UniTS: A Unified Multi-Task Time Series Modelcited by 93
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2024: 6; 2025: 10; 2026: 7.
23 papers.
Sort:
By area:
- 2025Performance of Zero-Shot Time Series Foundation Models on Cloud Datacited by 10
- 2024Repurposing Foundation Model for Generalizable Medical Time Series Classificationcited by 6
- 2024Generalized Prompt Tuning: Adapting Frozen Univariate Time Series Foundation Models for Multivariate Healthcare Time Seriescited by 5
- 2024FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modelingcited by 4
- 2024Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglementcited by 4
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challengescited by 2
- 2025The language of time: a language model perspective on time-series foundation modelscited by 2
- 2026ChronosAD: Leveraging Time Series Foundation Models for Accurate Anomaly Detectioncited by 2
- 2025The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysiscited by 1
- 2026Can LLM Coding Agents Reason About Time Series?cited by 1
- 2026Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Modelscited by 1
- 2024FlexTSF: A Flexible Forecasting Model for Time Series with Variable Regularitiescited by 0
11 more
- 2024Fine-Tuning Pre-trained Large Time Series Models for Prediction of Wind Turbine SCADA Datacited by 0
- 2025Evaluating Time Series Foundation Models on Noisy Periodic Time Seriescited by 0
- 2025LeForecast: Enterprise Hybrid Forecast by Time Series Intelligencecited by 0
- 2025Feature Fitted Online Conformal Prediction for Deep Time Series Forecasting Modelcited by 0
- 2025Gradient Flow Matching for Learning Update Dynamics in Neural Network Trainingcited by 0
- 2025ss-Mamba: Semantic-Spline Selective State-Space Modelcited by 0
- 2025Evaluation of Stress Detection as Time Series Events -- A Novel Window-Based F1-Metriccited by 0
- 2026SignalMC-MED: A Multimodal Benchmark for Evaluating Biosignal Foundation Models on Single-Lead ECG and PPGcited by 0
- 2026ARTEMIS: A Neuro Symbolic Framework for Economically Constrained Market Dynamicscited by 0
- 2026Model-agnostic Retrieval-Augmented Extended Forecasting for time seriescited by 0
- 2026Parameter-Efficient Adaptation of Pretrained Language Models for Time-Series Forecastingcited by 0
- 2026Parameter-Efficient Adaptation of Pretrained Language Models for Time-Series Forecasting14 Sep 2026
- 2026Model-agnostic Retrieval-Augmented Extended Forecasting for time series14 Aug 2026
- 2026Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Models8 Aug 2026
- 2026Can LLM Coding Agents Reason About Time Series?15 Jun 2026
- 2026ChronosAD: Leveraging Time Series Foundation Models for Accurate Anomaly Detection31 May 2026
- 2026ARTEMIS: A Neuro Symbolic Framework for Economically Constrained Market Dynamics18 Mar 2026
- 2026SignalMC-MED: A Multimodal Benchmark for Evaluating Biosignal Foundation Models on Single-Lead ECG and PPG10 Mar 2026
- 2025Evaluation of Stress Detection as Time Series Events -- A Novel Window-Based F1-Metric3 Sep 2025
- 2025The language of time: a language model perspective on time-series foundation models29 Jun 2025
- 2025The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysis13 Jun 2025
- 2025ss-Mamba: Semantic-Spline Selective State-Space Model3 Jun 2025
- 2025Gradient Flow Matching for Learning Update Dynamics in Neural Network Training26 May 2025
11 more
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challenges21 May 2025
- 2025Feature Fitted Online Conformal Prediction for Deep Time Series Forecasting Model13 May 2025
- 2025LeForecast: Enterprise Hybrid Forecast by Time Series Intelligence27 Mar 2025
- 2025Performance of Zero-Shot Time Series Foundation Models on Cloud Data18 Feb 2025
- 2025Evaluating Time Series Foundation Models on Noisy Periodic Time Series1 Jan 2025
- 2024Fine-Tuning Pre-trained Large Time Series Models for Prediction of Wind Turbine SCADA Data30 Nov 2024
- 2024Generalized Prompt Tuning: Adapting Frozen Univariate Time Series Foundation Models for Multivariate Healthcare Time Series19 Nov 2024
- 2024FlexTSF: A Flexible Forecasting Model for Time Series with Variable Regularities30 Oct 2024
- 2024Repurposing Foundation Model for Generalizable Medical Time Series Classification3 Oct 2024
- 2024Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglement3 Oct 2024
- 2024FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modeling24 May 2024
- 2026Can LLM Coding Agents Reason About Time Series?cited by 1
- 2026Can LLM Coding Agents Reason About Time Series?15 Jun 2026
- 2025ss-Mamba: Semantic-Spline Selective State-Space Modelcited by 0
- 2025ss-Mamba: Semantic-Spline Selective State-Space Model3 Jun 2025
- 2025Performance of Zero-Shot Time Series Foundation Models on Cloud Datacited by 10
- 2024Repurposing Foundation Model for Generalizable Medical Time Series Classificationcited by 6
- 2024Generalized Prompt Tuning: Adapting Frozen Univariate Time Series Foundation Models for Multivariate Healthcare Time Seriescited by 5
- 2024FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modelingcited by 4
- 2024Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglementcited by 4
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challengescited by 2
- 2025The language of time: a language model perspective on time-series foundation modelscited by 2
- 2026ChronosAD: Leveraging Time Series Foundation Models for Accurate Anomaly Detectioncited by 2
- 2026Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Modelscited by 1
- 2024FlexTSF: A Flexible Forecasting Model for Time Series with Variable Regularitiescited by 0
- 2024Fine-Tuning Pre-trained Large Time Series Models for Prediction of Wind Turbine SCADA Datacited by 0
- 2025Evaluating Time Series Foundation Models on Noisy Periodic Time Seriescited by 0
12 most cited of 18 All 18 (JSON)
- 2026Parameter-Efficient Adaptation of Pretrained Language Models for Time-Series Forecasting14 Sep 2026
- 2026Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Models8 Aug 2026
- 2026ChronosAD: Leveraging Time Series Foundation Models for Accurate Anomaly Detection31 May 2026
- 2026ARTEMIS: A Neuro Symbolic Framework for Economically Constrained Market Dynamics18 Mar 2026
- 2026SignalMC-MED: A Multimodal Benchmark for Evaluating Biosignal Foundation Models on Single-Lead ECG and PPG10 Mar 2026
- 2025Evaluation of Stress Detection as Time Series Events -- A Novel Window-Based F1-Metric3 Sep 2025
- 2025The language of time: a language model perspective on time-series foundation models29 Jun 2025
- 2025Large Language models for Time Series Analysis: Techniques, Applications, and Challenges21 May 2025
- 2025Feature Fitted Online Conformal Prediction for Deep Time Series Forecasting Model13 May 2025
- 2025LeForecast: Enterprise Hybrid Forecast by Time Series Intelligence27 Mar 2025
- 2025Performance of Zero-Shot Time Series Foundation Models on Cloud Data18 Feb 2025
- 2025Evaluating Time Series Foundation Models on Noisy Periodic Time Series1 Jan 2025
12 newest of 18 All 18 (JSON)