mlsanityData to 14 Oct 2026

Large Language models for Time Series Analysis: Techniques, Applications, and Challenges

arXiv 2506.11040 ↗First posted 21 May 2025cs.LG cs.CL cs.ETcited by 3

Not on the map. Why?

Abstract (arXiv)

Time series analysis is pivotal in domains like financial forecasting and biomedical monitoring, yet traditional methods are constrained by limited nonlinear feature representation and long-term dependency capture. The emergence of Large Language Models (LLMs) offers transformative potential by leveraging their cross-modal knowledge integration and inherent attention mechanisms for time series analysis. However, the development of general-purpose LLMs for time series from scratch is still hindered by data diversity, annotation scarcity, and computational requirements. This paper presents a systematic review of pre-trained LLM-driven time series analysis, focusing on enabling techniques, potential applications, and open challenges. First, it establishes an evolutionary roadmap of AI-driven time series analysis, from the early machine learning era, through the emerging LLM-driven paradigm, to the development of native temporal foundation models. Second, it organizes and systematizes the technical landscape of LLM-driven time series analysis from a workflow perspective, covering LLMs' input, optimization, and lightweight stages. Finally, it critically examines novel real-world applications and highlights key open challenges that can guide future research and innovation. The work not only provides valuable insights into current advances but also outlines promising directions for future development. It serves as a foundational reference for both academic and industrial researchers, paving the way for the development of more efficient, generalizable, and interpretable systems of LLM-driven time series analysis.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 86 of its 115 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

86 of 115 references.

References · 86

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  8. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  11. 2023A Survey of Large Language Modelscited by 2,576
  12. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
38 more
  1. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2019How Can We Know What Language Models Know?cited by 959
  4. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  5. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  6. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  7. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  8. 2023A decoder-only foundation model for time-series forecastingcited by 692
  9. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 650
  10. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  11. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
  12. 2016Tutorial on Variational Autoencoderscited by 409
  13. 2022Large Language Models Are Reasoning Teacherscited by 329
  14. 2023LLM-QAT: Data-Free Quantization Aware Training for Large Language Modelscited by 324
  15. 2023A Survey on Model Compression for Large Language Modelscited by 269
  16. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  17. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 172
  18. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
  19. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
  20. 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 129
  21. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  22. 2024Survey on Large Language Model-Enhanced Reinforcement Learning: Concept, Taxonomy, and Methodscited by 116
  23. 2024Large Language Models for Time Series: A Surveycited by 114
  24. 2023Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecastingcited by 113
  25. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 110
  26. 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 108
  27. 2021Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoTcited by 104
  28. 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 103
  29. 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflectioncited by 98
  30. 2024UniTS: A Unified Multi-Task Time Series Modelcited by 94
  31. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 80
  32. 2023Temporal Data Meets LLM -- Explainable Financial Time Series Forecastingcited by 77
  33. 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 71
  34. 2024LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancementcited by 70
  35. 2021Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classificationcited by 67
  36. 2024Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Datacited by 66
  37. 2022Model Reprogramming: Resource-Efficient Cross-Domain Machine Learningcited by 64
  38. 2024Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognitioncited by 63

50 most cited of 86 All 86 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Understanding Why Large Language Models Can Be Ineffective in Time Series Analysis: The Impact of Modality Alignment
  2. 2025When LLM Meets Time Series: Can LLMs Perform Multi-Step Time Series Reasoning and Inference
  3. 2026Rethinking the Role of LLMs in Time Series Forecasting
  4. 2025Toward Reasoning-Centric Time-Series Analysis
  5. 2026TimeSeriesExamAgent: Creating Time Series Reasoning Benchmarks at Scale
  6. 2024Can LLMs Understand Time Series Anomalies?
  7. 2025Fusing Large Language Models with Temporal Transformers for Time Series Forecasting
  8. 2025Efficient Model Selection for Time Series Forecasting via LLMs