VLT: A Vision-Language-Time Series Multimodal Foundation Model for Industrial Intelligence
On the map: Mixture-of-experts → MoE for time series and graphs
Abstract (arXiv)
Industrial time series serve as the foundation for Prognostics and Health Management (PHM) to ensure the reliability and safety of industrial equipment such as aero-engines. However, existing approaches are typically limited to single-modality modeling, which restricts their generalization in complex scenarios. Although recent advances in large language models (LLMs) provide new opportunities for multimodal learning, bridging continuous time-series signals and discrete textual semantics remains an open challenge. To this end, we propose VLT, a multimodal foundation model that jointly models time-series, frequency-spectrum visual representations, and textual knowledge. A key insight is to utilize the frequency spectrum as a visual bridge to connect continuous temporal signals with discrete semantics. Specifically, a Time-aware Mixture-of-Experts (Time-MoE) is designed to capture heterogeneous temporal dynamics, while a Frequency-Text Augmented Learner enables joint modeling of spectral and semantic features within a shared representation space. Furthermore, a time-centric gradient alignment mechanism is introduced to mitigate cross-modal optimization conflicts via gradient normalization and reliability-aware dynamic reweighting. Extensive experiments on multiple industrial datasets demonstrate that VLT outperforms state-of-the-art methods, achieving superior robustness and generalization under few-shot, noisy, and incomplete-modality settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 19 of its 48 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
19 of 48 references.
References · 19
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
- 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
7 more
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 168
- 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
- 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
- 2025GEM: Empowering MLLM for Grounded ECG Understanding with Time Series and Imagescited by 35
- 2023Graph Anomaly Detection in Time Series: A Surveycited by 18
- 2024Diff-MTS: Temporal-Augmented Conditional Diffusion-based AIGC for Industrial Time Series Towards the Large Model Eracited by 5
- 2024LLM-based Framework for Bearing Fault Diagnosiscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TS-MLLM: A Multi-Modal Large Language Model-based Framework for Industrial Time-Series Big Data Analysis
- 2025Time-VLM: Exploring Multimodal Vision-Language Models for Augmented Time Series Forecasting
- 2025MLLM4TS: Leveraging Vision and Multimodal Language Models for General Time-Series Analysis
- 2025TempoGPT: Enhancing Time Series Reasoning via Quantizing Embedding
- 2026MM-ISTS: Cooperating Irregularly Sampled Time Series Forecasting with Multimodal Vision-Text LLMs
- 2026TimeOmni-VL: Unified Models for Time Series Understanding and Generation
- 2024Towards Time Series Reasoning with LLMs
- 2024On the Feasibility of Vision-Language Models for Time-Series Classification