mlsanityData to 7 Oct 2026

Intervention-Aware Forecasting: Breaking Historical Limits from a System Perspective

arXiv 2405.13522 ↗First posted 22 May 2024cs.LG cs.AI cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

Traditional time series forecasting methods predominantly rely on historical data patterns, neglecting external interventions that significantly shape future dynamics. Through control-theoretic analysis, we show that the implicit "self-stimulation" assumption limits the accuracy of these forecasts. To overcome this limitation, we propose an Intervention-Aware Time Series Forecasting (IATSF) framework explicitly designed to incorporate external interventions. We particularly emphasize textual interventions due to their unique capability to represent qualitative or uncertain influences inadequately captured by conventional exogenous variables. We propose a leak-free benchmark composed of temporally synchronized textual intervention data across synthetic and real-world scenarios. To rigorously evaluate IATSF, we develop FIATS, a lightweight forecasting model that integrates textual interventions through Channel-Aware Adaptive Sensitivity Modeling (CASM) and Channel-Aware Parameter Sharing (CAPS) mechanisms, enabling the model to adjust its sensitivity to interventions and historical data in a channel-specific manner. Extensive empirical evaluations confirm that FIATS surpasses state-of-the-art methods, highlighting that forecasting improvements stem explicitly from modeling external interventions rather than increased model complexity alone.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 22 May 2024.

Builds on

17 of 30 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  5. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  9. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  10. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  11. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  12. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
5 more
  1. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
  2. 2023FITS: Modeling Time Series with 10k Parameterscited by 185
  3. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  4. 2024An Analysis of Linear Time Series Forecasting Modelscited by 40
  5. 2023Learning to Embed Time Series Patches Independentlycited by 34

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 6.

16 papers.

Sort:

By area:

  1. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
  2. 2025Time-MQA: Time Series Multi-Task Question Answering with Context Enhancementcited by 74
  3. 2025A Survey of Reasoning and Agentic Systems in Time Series with Large Language Modelscited by 21
  4. 2025Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Modelscited by 15
  5. 2026TemporalBench: A Benchmark for Evaluating LLM-Based Agents on Contextual and Event-Informed Time Series Taskscited by 15
  6. 2025Fidel-TS: A High-Fidelity Multimodal Benchmark for Time Series Forecastingcited by 5
  7. 2025QuAnTS: Question Answering on Time Seriescited by 5
  8. 2024Text2Freq: Learning Series Patterns from Text via Frequency Domaincited by 4
  9. 2025Dual-Forecaster: A Multimodal Time Series Model Integrating Descriptive and Predictive Textscited by 3
  10. 2026Position: Universal Time Series Foundation Models Rest on a Category Errorcited by 1
  11. 2026Empowering Time Series Analysis with Large-Scale Multimodal Pretrainingcited by 1
  12. 2026EventCast: Hybrid Demand Forecasting in E-Commerce with LLM-Based Event Knowledgecited by 1
4 more
  1. 2026What if Tomorrow is the World Cup Final? Counterfactual Time Series Forecasting with Textual Conditionscited by 1
  2. 2025ss-Mamba: Semantic-Spline Selective State-Space Modelcited by 0
  3. 2025H3M-SSMoEs: Hypergraph-based Multimodal Learning with LLM Reasoning and Style-Structured Mixture of Expertscited by 0
  4. 2026MacroLens: A Multi-Task Benchmark for Contextual Financial Reasoning under Macroeconomic Scenarioscited by 0