InA-Probe: Instruction-Aware Active Probing for Time Series Forecasting with LLMs
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have recently demonstrated impressive potential for time series forecasting. However, existing methods predominantly rely on passive modality alignment or static task reprogramming, which often fail to capture fine-grained, non-stationary temporal patterns or to adapt to nuanced task intents. In this paper, we propose Instruction-aware Active Probing (InA-Probe), which shifts the paradigm from passive alignment toward an active, instruction-driven probing mechanism. Specifically, we design a Multi-Level Instruction Injection mechanism that enriches the model with both global task objectives and fine-grained, patch-level semantic priors. Building on this, an Adaptive Query Generation module produces sample-specific probes that are dynamically modulated by the temporal context. These probes are then refined through a dual-stage attention process: they first internalize task-specific intents via Instruction-Aware Self-Attention, and subsequently interrogate the projected temporal representations through Temporal Cross-Attention to extract salient patterns. Comprehensive experiments on seven real-world benchmarks show that InA-Probe consistently outperforms state-of-the-art deep learning and LLM-based baselines, excelling in both one-for-all generalization and zero-shot transfer while reducing forecasting error by up to 37% in challenging cross-domain scenarios. Ablation studies further confirm that the synergy between adaptive querying and fine-grained instructions is key to unlocking the reasoning power of LLMs for complex time series.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
32 of 40 references.
References · 32
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2024Qwen2 Technical Reportcited by 2,120
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
20 more
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
- 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2024Large Language Models for Time Series: A Surveycited by 114
- 2024CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuningcited by 108
- 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignmentcited by 103
- 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 87
- 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 74
- 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
- 2025Context-Alignment: Activating and Enhancing LLM Capabilities in Time Seriescited by 39
- 2019Deep Learning for Time Series Forecasting: The Electric Load Casecited by 31
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025When LLM Meets Time Series: Can LLMs Perform Multi-Step Time Series Reasoning and Inference
- 2026Thoth: Mid-Training Bridges LLMs to Time Series Understanding
- 2025STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions
- 2026Rethinking the Role of LLMs in Time Series Forecasting
- 2024NeST: Neighborhood-aware semantic alignment and temporal modulation for LLM based time series forecasting
- 2025Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment
- 2025Can Slow-thinking LLMs Reason Over Time? Empirical Studies in Time Series Forecasting
- 2025Small but Mighty: Enhancing Time Series Forecasting with Lightweight LLMs