InstructTime++: Time Series Classification with Multimodal Language Modeling via Implicit Feature Enhancement
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
Most existing time series classification methods adopt a discriminative paradigm that maps input sequences directly to one-hot encoded class labels. While effective, this paradigm struggles to incorporate contextual features and fails to capture semantic relationships among classes. To address these limitations, we propose InstructTime, a novel framework that reformulates time series classification as a multimodal generative task. Specifically, continuous numerical sequences, contextual textual features, and task instructions are treated as multimodal inputs, while class labels are generated as textual outputs by tuned language models. To bridge the modality gap, InstructTime introduces a time series discretization module that converts continuous sequences into discrete temporal tokens, together with an alignment projection layer and a generative self-supervised pre-training strategy to enhance cross-modal representation alignment. Building upon this framework, we further propose InstructTime++, which extends InstructTime by incorporating implicit feature modeling to compensate for the limited inductive bias of language models. InstructTime++ leverages specialized toolkits to mine informative implicit patterns from raw time series and contextual inputs, including statistical feature extraction and vision-language-based image captioning, and translates them into textual descriptions for seamless integration. Extensive experiments on multiple benchmark datasets demonstrate the superior performance of InstructTime++.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 59 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
31 of 59 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 453
- 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
19 more
- 2021Pay Attention to MLPscited by 368
- 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 345
- 2018The UEA multivariate time series classification archive, 2018cited by 338
- 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 190
- 2019EKT: Exercise-aware Knowledge Tracing for Student Performance Predictioncited by 109
- 2023Bake off redux: a review and experimental evaluation of recent time series classification algorithmscited by 101
- 2013A Time Series Forest for Classification and Feature Extractioncited by 69
- 2019TS-CHIEF: A Scalable and Accurate Forest Algorithm for Time Series Classificationcited by 67
- 2021Gated Transformer Networks for Multivariate Time Series Classificationcited by 58
- 2023TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoderscited by 44
- 2020Approaches and Applications of Early Classification of Time Series: A Reviewcited by 40
- 2024ConvTimeNet: A Deep Hierarchical Fully Convolutional Model for Multivariate Time Series Analysiscited by 27
- 2023FormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series Classificationcited by 21
- 2025A Comprehensive Survey on Composed Image Retrievalcited by 17
- 2024Generative Pretrained Hierarchical Transformer for Time Series Forecastingcited by 15
- 2025From Values to Tokens: An LLM-Driven Framework for Context-aware Time Series Forecasting via Symbolic Discretizationcited by 13
- 2024Cross-Domain Pre-training with Language Models for Transferable Time Series Representationscited by 12
- 2023Continuous-time Autoencoders for Regular and Irregular Time Series Imputationcited by 6
- 2025Watermarking Large Language Model-based Time Series Forecastingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Advancing Time Series Classification with Multimodal Language Modeling
- 2024Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification
- 2024TableTime: Reformulating Time Series Classification as Training-Free Table Understanding with Large Language Models
- 2024On the Feasibility of Vision-Language Models for Time-Series Classification
- 2025TempoGPT: Enhancing Time Series Reasoning via Quantizing Embedding
- 2026Prototype-Guided Classification Sub-Task Decoupling Framework: Enhancing Generalization and Interpretability for Multivariate Time Series
- 2025TimeSense:Making Large Language Models Proficient in Time-Series Analysis
- 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting