Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling
Not on the map. Why?
Abstract (arXiv)
Modern time series architectures face a fundamental trade-off: channel-independent models scale well with increasing data volume but ignore critical inter-channel dependencies, while channel-dependent models are expressive but remain ``dimension-bounded'', struggling to generalize across heterogeneous datasets.To bridge this gap, we introduce Unicorn (Universal Correlation Network), a framework for scalable, multi-dataset pretraining on high-dimensional time series. At the core of Unicorn is a latent prototype codebook that decouples correlation modeling from specific channel identities. By projecting heterogeneous channels into a shared latent space, UniCorN learns identity-agnostic, reusable interaction patterns that transfer across domains with diverse dimensionalities and semantics. Extensive experiments show that Unicorn significantly outperforms state-of-the-art forecasting architectures, particularly in few-shot transfer scenarios, offering a scalable path toward multivariate time series foundation models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 39 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
33 of 39 references.
References · 33
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
21 more
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 174
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
- 2023TimeGPT-1cited by 158
- 2024SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameterscited by 107
- 2019Deep Factors for Forecastingcited by 86
- 2024SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusioncited by 76
- 2021Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecastingcited by 32
- 2025Kronos: A Foundation Model for the Language of Financial Marketscited by 26
- 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecastingcited by 3
Built on by
Not cited yet.