QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Irregular multivariate time series forecasting is a challenging yet important problem in real-world applications, where observations are often irregularly sampled and asynchronously recorded across variables. Existing time series foundation models are mostly built on regularly sampled sequences, making them difficult to generalize to irregular time intervals and asynchronous cross-variable dependencies. To address these challenges, we propose QiYao-I, a manifold based foundation model for irregular multivariate time series forecasting. Specifically, we introduce a novel sampling-conditioned temporal manifold attention mechanism that maps real timestamps into a learnable temporal manifold feature space and injects temporal manifold biases into attention layers, enabling the model to capture both irregular time intervals and local sampling structures. Further, we propose a dynamic variable interaction mechanism with frequency awareness. It selectively performs cross-variable message passing under asynchronous observations. Extensive experiments on real-world irregular multivariate forecasting benchmarks demonstrate that QiYao-I achieves superior performance compared with both time series foundation models and end-to-end irregular forecasting models, showing strong generalization ability in zero-shot and few-shot settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 62 references that are in the map. First posted on arXiv 3 Oct 2026.
Builds on
48 of 62 references.
References · 48
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 238
- 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
- 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
- 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
36 more
- 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2019Set Functions for Time Seriescited by 138
- 2023Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecastingcited by 113
- 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 111
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
- 2021Neural Flows: Efficient Alternative to Neural ODEscited by 101
- 2025Controllable Video Generation: A Surveycited by 98
- 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 94
- 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 69
- 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 60
- 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 55
- 2025Rethinking Irregular Time Series Forecasting: A Simple yet Effective Baselinecited by 55
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
- 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspectivecited by 39
- 2025DAG: A Dual Correlation Network for Time Series Forecasting with Exogenous Variablescited by 33
- 2024Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfercited by 32
- 2026Toto 2.0: Time Series Forecasting Enters the Scaling Eracited by 30
- 2025LightGTS: A Lightweight General Time Series Forecasting Modelcited by 29
- 2026TimeART: Towards Agentic Time Series Reasoning via Tool-Augmentationcited by 26
- 2025MIRA: Medical Time Series Foundation Model for Real-World Health Datacited by 22
- 2025Merlin: Multi-View Representation Learning for Robust Multivariate Time Series Forecasting with Unfixed Missing Ratescited by 20
- 2024Graph Neural Flows for Unveiling Systemic Interactions Among Irregularly Sampled Time Seriescited by 15
- 2025HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series Forecastingcited by 15
- 2026GCGNet: Graph-Consistent Generative Network for Time Series Forecasting with Exogenous Variablescited by 13
- 2024CESNET-TimeSeries24: Time Series Dataset for Network Traffic Anomaly Detection and Forecastingcited by 12
- 2023BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decompositioncited by 10
- 2026Bridging Time and Frequency: A Joint Modeling Framework for Irregular Multivariate Time Series Forecastingcited by 9
- 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecastingcited by 8
- 2025PYRREGULAR: A Unified Framework for Irregular Time Series, with Classification Benchmarkscited by 7
- 2025STAR: Boosting Time Series Foundation Models for Anomaly Detection through State-aware Adaptercited by 7
- 2026CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware Adaptercited by 7
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
- 2025AimTS: Augmented Series and Image Contrastive Learning for Time Series Classificationcited by 6
Built on by
Not cited yet.