mlsanityData to 14 Oct 2026

QiYao-I: A Manifold Based Foundation Model for Irregular Multivariate Time Series Forecasting

arXiv 2610.06936 ↗First posted 3 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Irregular multivariate time series forecasting is a challenging yet important problem in real-world applications, where observations are often irregularly sampled and asynchronously recorded across variables. Existing time series foundation models are mostly built on regularly sampled sequences, making them difficult to generalize to irregular time intervals and asynchronous cross-variable dependencies. To address these challenges, we propose QiYao-I, a manifold based foundation model for irregular multivariate time series forecasting. Specifically, we introduce a novel sampling-conditioned temporal manifold attention mechanism that maps real timestamps into a learnable temporal manifold feature space and injects temporal manifold biases into attention layers, enabling the model to capture both irregular time intervals and local sampling structures. Further, we propose a dynamic variable interaction mechanism with frequency awareness. It selectively performs cross-variable message passing under asynchronous observations. Extensive experiments on real-world irregular multivariate forecasting benchmarks demonstrate that QiYao-I achieves superior performance compared with both time series foundation models and end-to-end irregular forecasting models, showing strong generalization ability in zero-shot and few-shot settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 62 references that are in the map. First posted on arXiv 3 Oct 2026.

Builds on

48 of 62 references.

References · 48

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2023A decoder-only foundation model for time-series forecastingcited by 692
  3. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  4. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  5. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
  6. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  7. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 287
  8. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  9. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 238
  10. 2024GIFT-Eval: A Benchmark For General Time Series Forecasting Model Evaluationcited by 212
  11. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  12. 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
36 more
  1. 2025Sundial: A Family of Highly Capable Time Series Foundation Modelscited by 180
  2. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  3. 2019Set Functions for Time Seriescited by 138
  4. 2023Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecastingcited by 113
  5. 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 111
  6. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
  7. 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
  8. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 101
  9. 2025Controllable Video Generation: A Surveycited by 98
  10. 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
  11. 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 94
  12. 2025Moirai 2.0: When Less Is More for Time Series Forecastingcited by 69
  13. 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 60
  14. 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 55
  15. 2025Rethinking Irregular Time Series Forecasting: A Simple yet Effective Baselinecited by 55
  16. 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 45
  17. 2025Enhancing Time Series Forecasting through Selective Representation Spaces: A Patch Perspectivecited by 39
  18. 2025DAG: A Dual Correlation Network for Time Series Forecasting with Exogenous Variablescited by 33
  19. 2024Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfercited by 32
  20. 2026Toto 2.0: Time Series Forecasting Enters the Scaling Eracited by 30
  21. 2025LightGTS: A Lightweight General Time Series Forecasting Modelcited by 29
  22. 2026TimeART: Towards Agentic Time Series Reasoning via Tool-Augmentationcited by 26
  23. 2025MIRA: Medical Time Series Foundation Model for Real-World Health Datacited by 22
  24. 2025Merlin: Multi-View Representation Learning for Robust Multivariate Time Series Forecasting with Unfixed Missing Ratescited by 20
  25. 2024Graph Neural Flows for Unveiling Systemic Interactions Among Irregularly Sampled Time Seriescited by 15
  26. 2025HyperIMTS: Hypergraph Neural Network for Irregular Multivariate Time Series Forecastingcited by 15
  27. 2026GCGNet: Graph-Consistent Generative Network for Time Series Forecasting with Exogenous Variablescited by 13
  28. 2024CESNET-TimeSeries24: Time Series Dataset for Network Traffic Anomaly Detection and Forecastingcited by 12
  29. 2023BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decompositioncited by 10
  30. 2026Bridging Time and Frequency: A Joint Modeling Framework for Irregular Multivariate Time Series Forecastingcited by 9
  31. 2025ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecastingcited by 8
  32. 2025PYRREGULAR: A Unified Framework for Irregular Time Series, with Classification Benchmarkscited by 7
  33. 2025STAR: Boosting Time Series Foundation Models for Anomaly Detection through State-aware Adaptercited by 7
  34. 2026CoRA: Boosting Time Series Foundation Models for Multivariate Forecasting through Correlation-aware Adaptercited by 7
  35. 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
  36. 2025AimTS: Augmented Series and Image Contrastive Learning for Time Series Classificationcited by 6

Built on by

Not cited yet.