mlsanityData to 14 Oct 2026

CTIA-ODE: Continuous-Time Inter-Variable Attention for Long-Term Time Series Forecasting

arXiv 2610.19831 ↗First posted 14 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Although multivariate time series forecasting has broad application prospects, effectively incorporating exogenous variables remains challenging. Prevailing discrete-time architectures often impose rigid temporal alignment across heterogeneous variables, which may limit their ability to capture continuously evolving external effects. To address this limitation, we introduce CTIA-ODE, a continuous-time forecasting framework centered on Continuous-Time Inter-Variable Attention (CTIA). Specifically, CTIA is embedded within an ordinary differential equation (ODE) solver, enabling the continuously evolving endogenous trajectory to dynamically query a static exogenous context along the integration path without requiring explicit temporal alignment. To improve the stability of the continuous latent dynamics, we further introduce a dual-stabilization strategy: architecturally, a Linear Residual Augmentation (LRA) module provides a macroscopic trend anchor, while an Outlier-Robust Hybrid Loss (ORHL) mitigates the influence of heavy-tailed anomalies during optimization. Extensive experiments across eight real-world datasets demonstrate that CTIA-ODE achieves state-of-the-art forecasting performance across diverse datasets and prediction horizons, while maintaining a favorable accuracy-efficiency trade-off with a compact memory footprint and low inference latency, particularly under long-horizon forecasting settings. Anonymous code is available at https://anonymous.4open.science/r/CTIA-ODE-15A6/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 54 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

32 of 54 references.

References · 32

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  8. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  9. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  10. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
  11. 2019Augmented Neural ODEscited by 397
  12. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
20 more
  1. 2020Liquid Time-constant Networkscited by 161
  2. 2020Dissecting Neural ODEscited by 153
  3. 2024Is Mamba Effective for Time Series Forecasting?cited by 114
  4. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 93
  5. 2024Timer-XL: Long-Context Transformers for Unified Time Series Forecastingcited by 87
  6. 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 70
  7. 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 55
  8. 2024A Comprehensive Survey of Deep Learning for Time Series Forecasting: Architectural Diversity and Open Challengescited by 47
  9. 2020A Review of Deep Learning Methods for Irregularly Sampled Medical Time Series Datacited by 31
  10. 2025CrossLinear: Plug-and-Play Cross-Correlation Embedding for Time Series Forecasting with Exogenous Variablescited by 22
  11. 2025Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecastingcited by 20
  12. 2024Macroeconomic Forecasting with Large Language Modelscited by 8
  13. 2025AutoHFormer: Efficient Hierarchical Autoregressive Transformer for Time Series Predictioncited by 8
  14. 2024Improving Adaptivity via Over-Parameterization in Sequence Modelscited by 3
  15. 2024Tackling Data Heterogeneity in Federated Time Series Forecastingcited by 3
  16. 2025Wavelet Mixture of Experts for Time Series Forecastingcited by 2
  17. 2025MillGNN: Learning Multi-Scale Lead-Lag Dependencies for Multi-Variate Time Series Forecastingcited by 2
  18. 2026MODE: Efficient Time Series Prediction with Mamba Enhanced by Low-Rank Neural ODEscited by 2
  19. 2026Assessing Electricity Demand Forecasting with Exogenous Data in Time Series Foundation Modelscited by 2
  20. 2025COGNOS: Universal Enhancement for Time Series Anomaly Detection via Constrained Gaussian-Noise Optimization and Smoothingcited by 1

Built on by

Not cited yet.