mlsanityData to 14 Oct 2026

Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling

arXiv 2605.30376 ↗First posted 26 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern time series architectures face a fundamental trade-off: channel-independent models scale well with increasing data volume but ignore critical inter-channel dependencies, while channel-dependent models are expressive but remain ``dimension-bounded'', struggling to generalize across heterogeneous datasets.To bridge this gap, we introduce Unicorn (Universal Correlation Network), a framework for scalable, multi-dataset pretraining on high-dimensional time series. At the core of Unicorn is a latent prototype codebook that decouples correlation modeling from specific channel identities. By projecting heterogeneous channels into a shared latent space, UniCorN learns identity-agnostic, reusable interaction patterns that transfer across domains with diverse dimensionalities and semantics. Extensive experiments show that Unicorn significantly outperforms state-of-the-art forecasting architectures, particularly in few-shot transfer scenarios, offering a scalable path toward multivariate time series foundation models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

33 of 39 references.

References · 33

  1. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  5. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  6. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  7. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  8. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  9. 2024Chronos: Learning the Language of Time Seriescited by 759
  10. 2023A decoder-only foundation model for time-series forecastingcited by 692
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  12. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
21 more
  1. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  2. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
  3. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  4. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  5. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  6. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  7. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
  8. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  9. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  10. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
  11. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  12. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  13. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
  14. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  15. 2023TimeGPT-1cited by 158
  16. 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 107
  17. 2019Deep Factors for Forecastingcited by 86
  18. 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
  19. 2021Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecastingcited by 32
  20. 2025Kronos: A Foundation Model for the Language of Financial Marketscited by 26
  21. 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecastingcited by 3

Built on by

Not cited yet.