mlsanityData to 7 Oct 2026

From Images to Signals: Are Large Vision Models Useful for Time Series Analysis?

arXiv 2505.24030 ↗First posted 29 May 2025cs.LG cs.AI cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Transformer-based models have gained increasing attention in time series research, driving interest in Large Language Models (LLMs) and foundation models for time series analysis. As the field moves toward multi-modality, Large Vision Models (LVMs) are emerging as a promising direction. In the past, the effectiveness of Transformer and LLMs in time series has been debated. When it comes to LVMs, a similar question arises: are LVMs truely useful for time series analysis? To address it, we design and conduct the first principled study involving 4 LVMs, 8 imaging methods, 18 datasets and 26 baselines across both high-level (classification) and low-level (forecasting) tasks, with extensive ablation analysis. Our findings indicate LVMs are indeed useful for time series classification but face challenges in forecasting. Although effective, the contemporary best LVM forecasters are limited to specific types of LVMs and imaging methods, exhibit a bias toward forecasting periods, and have limited ability to utilize long look-back windows. We hope our findings could serve as a cornerstone for future research on LVM- and multimodal-based solutions to different time series tasks.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 62 of its 67 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

62 of 67 references.

References · 62

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  9. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  10. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  11. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  12. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
38 more
  1. 2020Reformer: The Efficient Transformercited by 1,658
  2. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  3. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  4. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  5. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  6. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  8. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  9. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  10. 2021AST: Audio Spectrogram Transformercited by 634
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  12. 2022Transformers in Time Series: A Surveycited by 489
  13. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  14. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  15. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  16. 2018The UEA multivariate time series classification archive, 2018cited by 330
  17. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  18. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
  19. 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
  20. 2022ADBench: Anomaly Detection Benchmarkcited by 230
  21. 2018A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Datacited by 181
  22. 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 166
  23. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
  24. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  25. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 146
  26. 2024Large Language Models for Time Series: A Surveycited by 113
  27. 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 105
  28. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 103
  29. 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
  30. 2015Imaging Time-Series to Improve Classification and Imputationcited by 85
  31. 2023Time Series as Images: Vision Transformer for Irregularly Sampled Time Seriescited by 79
  32. 2021Time Series Prediction using Deep Learning Methods in Healthcarecited by 71
  33. 2017Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Predictioncited by 67
  34. 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 64
  35. 2024Empowering Time Series Analysis with Large Language Models: A Surveycited by 60
  36. 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecastingcited by 59
  37. 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
  38. 2022TTS-GAN: A Transformer-based Time-Series Generative Adversarial Networkcited by 41

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.