mlsanityData to 14 Oct 2026

ChronoSteer: Bridging Large Language Model and Time Series Foundation Model via Synthetic Cross-Modal Alignment Dataset

arXiv 2505.10083 ↗First posted 15 May 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Conventional forecasting methods are trained end-to-end on unimodal time series, which limits their ability to exploit textual information and undermines their generalization in data-scarce scenarios. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful capabilities in complex textual reasoning and zero-shot temporal modeling, respectively. Integrating these strengths to construct a multimodal time series foundation model that jointly leverages temporal and textual information for zero-shot future inference has emerged as a promising research direction. However, the scarcity of large-scale, high-quality multimodal datasets remains a fundamental obstacle. To address this challenge, we propose ChronoSteer, a decoupled agentic framework that learns cross-modal alignment from synthetic paired supervision. Specifically, a pretrained LLM first converts textual events into revision instructions that steer the initial unimodal prediction produced by a frozen TSFM. These revision instructions form an intermediate instruction space that bridges the semantic gap between text and time series while fully leveraging pretrained knowledge. Technically, the instructions are discretized into a compact codebook of instruction anchors, effectively mitigating semantic divergence while reducing the cost of dataset construction. Finally, we adopt a two-stage training strategy to recover the fine-grained magnitude information lost during discretization. Furthermore, we release a leakage-controlled multimodal benchmark constructed with temporal separation and textual context available before the prediction window. When paired with an LLM and trained on synthetic cross-modal alignment data, ChronoSteer achieves a 25.8% improvement in zero-shot prediction accuracy over its unimodal backbone, and outperforms prior state-of-the-art unimodal and multimodal ...

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 15 May 2025.

Builds on

26 of 56 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  5. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  6. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  7. 2017Dense-Captioning Events in Videoscited by 793
  8. 2024Chronos: Learning the Language of Time Seriescited by 759
  9. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  10. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  11. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  12. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
14 more
  1. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  2. 2021Monash Time Series Forecasting Archivecited by 267
  3. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  4. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
  5. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 100
  6. 2024Language Models Still Struggle to Zero-shot Reason about Time Seriescited by 88
  7. 2024Context is Key: A Benchmark for Forecasting with Essential Textual Informationcited by 87
  8. 2024LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Promptingcited by 59
  9. 2024TimeSeriesExam: A time series understanding examcited by 49
  10. 2025Context-Alignment: Activating and Enhancing LLM Capabilities in Time Seriescited by 39
  11. 2024Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmarkcited by 38
  12. 2024A Picture is Worth A Thousand Numbers: Enabling LLMs Reason about Time Series via Visualizationcited by 33
  13. 2025The First Few Tokens Are All You Need: An Efficient and Effective Unsupervised Prefix Fine-Tuning Method for Reasoning Modelscited by 31
  14. 2025AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecastingcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing LLMs for Time Series Forecasting via Structure-Guided Cross-Modal Alignment
  2. 2024TS-HTFA: Advancing Time Series Forecasting via Hierarchical Text-Free Alignment with Large Language Models
  3. 2025Multimodal Language Models with Modality-Specific Experts for Financial Forecasting from Interleaved Sequences of Text and Time Series
  4. 2025BALM-TSF: Balanced Multimodal Alignment for LLM-Based Time Series Forecasting
  5. 2026KairosAgent: Agentic Time Series Forecasting with Fused Semantic Reasoning
  6. 2025Aurora: Towards Universal Generative Multimodal Time Series Forecasting
  7. 2025Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment
  8. 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignment