From Images to Signals: Are Large Vision Models Useful for Time Series Analysis?
Not on the map. Why?
Abstract (arXiv)
Transformer-based models have gained increasing attention in time series research, driving interest in Large Language Models (LLMs) and foundation models for time series analysis. As the field moves toward multi-modality, Large Vision Models (LVMs) are emerging as a promising direction. In the past, the effectiveness of Transformer and LLMs in time series has been debated. When it comes to LVMs, a similar question arises: are LVMs truely useful for time series analysis? To address it, we design and conduct the first principled study involving 4 LVMs, 8 imaging methods, 18 datasets and 26 baselines across both high-level (classification) and low-level (forecasting) tasks, with extensive ablation analysis. Our findings indicate LVMs are indeed useful for time series classification but face challenges in forecasting. Although effective, the contemporary best LVM forecasters are limited to specific types of LVMs and imaging methods, exhibit a bias toward forecasting periods, and have limited ability to utilize long look-back windows. We hope our findings could serve as a cornerstone for future research on LVM- and multimodal-based solutions to different time series tasks.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 62 of its 67 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
62 of 67 references.
References · 62
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Visual Instruction Tuningcited by 7,792
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
38 more
- 2020Reformer: The Efficient Transformercited by 1,658
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2021AST: Audio Spectrogram Transformercited by 634
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2022Transformers in Time Series: A Surveycited by 489
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 267
- 2014Understanding image representations by measuring their equivariance and equivalencecited by 240
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2018A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Datacited by 181
- 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 166
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
- 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 146
- 2024Large Language Models for Time Series: A Surveycited by 113
- 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 105
- 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 103
- 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
- 2015Imaging Time-Series to Improve Classification and Imputationcited by 85
- 2023Time Series as Images: Vision Transformer for Irregularly Sampled Time Seriescited by 79
- 2021Time Series Prediction using Deep Learning Methods in Healthcarecited by 71
- 2017Learning Traffic as Images: A Deep Convolutional Neural Network for Large-Scale Transportation Network Speed Predictioncited by 67
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 64
- 2024Empowering Time Series Analysis with Large Language Models: A Surveycited by 60
- 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecastingcited by 59
- 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
- 2022TTS-GAN: A Transformer-based Time-Series Generative Adversarial Networkcited by 41
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025SVTime: Small Time Series Forecasting Models Informed by "Physics" of Large Vision Model Forecasterscited by 2
- 2025Rating Quality of Diverse Time Series Data by Meta-learning from LLM Judgmentcited by 1
- 2025CLIPTime: Time-Aware Multimodal Representation Learning from Images and Textcited by 0
- 2026From Consistency to Complementarity: Aligned and Disentangled Multi-modal Learning for Time Series Understanding and Reasoningcited by 0
- 2026VAN-AD: Visual Masked Autoencoder with Normalizing Flow For Time Series Anomaly Detectioncited by 0
- 2026Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoningcited by 0
- 2026ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMscited by 0
- 2026ViSTA: A Simple Bridge Extends Visual Alignment to Clinical Time-Series Understanding in Multimodal LLMs25 Sep 2026
- 2026Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning10 May 2026
- 2026VAN-AD: Visual Masked Autoencoder with Normalizing Flow For Time Series Anomaly Detection27 Mar 2026
- 2026From Consistency to Complementarity: Aligned and Disentangled Multi-modal Learning for Time Series Understanding and Reasoning29 Jan 2026
- 2025SVTime: Small Time Series Forecasting Models Informed by "Physics" of Large Vision Model Forecasters10 Oct 2025
- 2025CLIPTime: Time-Aware Multimodal Representation Learning from Images and Text1 Aug 2025
- 2025Rating Quality of Diverse Time Series Data by Meta-learning from LLM Judgment2 Jun 2025