mlsanityData to 14 Oct 2026

VLBM: Variational Latent Basis Modeling for OOD Robust Multivariate Time Series Forecasting

arXiv 2606.02138 ↗First posted 1 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Out of distribution (OOD) events in multivariate time series forecasting are rare but often dominate real world risk, making average case forecasting insufficient for reliable deployment. Under standard average risk training on mixed ID/OOD distributions, optimization signals from rare OOD events can be overwhelmed by frequent in distribution (ID) patterns, so strong benchmark accuracy may not translate into reliability under high impact shifts. To address this issue, we propose VLBM (Variational Latent Basis Model), a theory guided latent forecasting framework that separates stable dynamics from OOD induced deviations. VLBM learns a shared latent basis that defines a low rank subspace for stable ID dynamics, explicitly decomposes inputs into basis subspace components and orthogonal residual components, and aligns a future aware posterior with a future blind prior so that test time latent inference depends only on historical input. Across 12 benchmark tasks spanning transportation, weather, power systems, and other real world domains, including newly constructed real world OOD traffic datasets, VLBM achieves state of the art OOD robustness and ID accuracy, with average MAE and MSE gains of 15.08% and 7.74% over the strongest baseline. On a synthetic simulation dataset, VLBM also consistently achieves the best performance and better tracks OOD pulse recovery. These results support latent structured forecasting as a principled route to robust prediction under mixed ID and OOD conditions. The code is available at https://github.com/leijieruilq/VLBMOODforecast.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 59 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

40 of 59 references.

References · 40

  1. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  2. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  3. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  4. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  5. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  6. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  7. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  8. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  9. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  10. 2018Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholdingcited by 410
  11. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  12. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
28 more
  1. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  2. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
  3. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  4. 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 123
  5. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
  6. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
  7. 2024TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignmentcited by 103
  8. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 101
  9. 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 99
  10. 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 94
  11. 2022Spatio-Temporal Meta-Graph Learning for Traffic Forecastingcited by 88
  12. 2025TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecastingcited by 64
  13. 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 60
  14. 2023MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecastingcited by 50
  15. 2024Towards a General Time Series Anomaly Detector with Adaptive Bottlenecks and Dual Adversarial Decoderscited by 38
  16. 2025Patch-wise Structural Loss for Time Series Forecastingcited by 35
  17. 2024Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfercited by 32
  18. 2025Temporal Query Network for Efficient Multivariate Time Series Forecastingcited by 31
  19. 2025TimeKAN: KAN-based Frequency Decomposition Learning Architecture for Long-term Time Series Forecastingcited by 30
  20. 2024Time-Series Forecasting for Out-of-Distribution Generalization Using Invariant Learningcited by 27
  21. 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
  22. 2025FreEformer: Frequency Enhanced Transformer for Multivariate Time Series Forecastingcited by 18
  23. 2025FilterTS: Comprehensive Frequency Filtering for Multivariate Time Series Forecastingcited by 16
  24. 2025TimePro: Efficient Multivariate Long-term Time Series Forecasting with Variable- and Time-Aware Hyper-statecited by 16
  25. 2024TimeDART: A Diffusion Autoregressive Transformer for Self-Supervised Time Series Representationcited by 14
  26. 2023Seeing the Unseen: Learning Basis Confounder Representations for Robust Traffic Predictioncited by 12
  27. 2025When Will It Fail?: Anomaly to Prompt for Forecasting Future Anomalies in Time Seriescited by 7
  28. 2024DualCast: A Model to Disentangle Aperiodic Events from Traffic Seriescited by 4

Built on by

Not cited yet.