mlsanityData to 14 Oct 2026

U-Cast: Learning Hierarchical Structures for High-Dimensional Time Series Forecasting

arXiv 2507.15119 ↗First posted 20 Jul 2025cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Time series forecasting (TSF) is a central problem in time series analysis. However, as the number of channels in time series datasets scales to the thousands or more, a scenario we define as High-Dimensional Time Series Forecasting (HDTSF), it introduces significant new modeling challenges that are often not the primary focus of traditional TSF research. HDTSF is challenging because the channel correlation often forms complex and hierarchical patterns. Existing TSF models either ignore these interactions or fail to scale as dimensionality grows. To address this issue, we propose U-Cast, a channel-dependent forecasting architecture that learns latent hierarchical channel structures with an innovative query-based attention. To disentangle highly correlated channel representation, U-Cast adds a full-rank regularization during training. We also release Time-HD, the first benchmark of large, diverse, high-dimensional datasets. Our theory shows that exploiting cross-channel information lowers forecasting risk, and experiments on Time-HD demonstrate that U-Cast surpasses strong baselines in both accuracy and efficiency. Together, U-Cast and Time-HD provide a solid basis for future HDTSF research.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 20 Jul 2025.

Builds on

33 of 58 references.

References · 33

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  8. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  9. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  10. 2024Chronos: Learning the Language of Time Seriescited by 759
  11. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  12. 2023A decoder-only foundation model for time-series forecastingcited by 692
21 more
  1. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  2. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  3. 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
  4. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  5. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  6. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  7. 2021Monash Time Series Forecasting Archivecited by 267
  8. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  9. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
  10. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  11. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
  12. 2023FITS: Modeling Time Series with 10k Parameterscited by 195
  13. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
  14. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
  15. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 107
  16. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
  17. 2024From Similarity to Superiority: Channel Clustering for Time Series Forecastingcited by 37
  18. 2024Rethinking Channel Dependence for Multivariate Time Series Forecasting: Learning from Leading Indicatorscited by 32
  19. 2025TimeDistill: Efficient Long-Term Time Series Forecasting with MLP via Cross-Architecture Distillationcited by 12
  20. 2022An Extreme-Adaptive Time Series Prediction Model Based on Probability-Enhanced LSTM Neural Networkscited by 9
  21. 2024EpiLearn: A Python Library for Machine Learning in Epidemic Modelingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.