QuITE: Query-Based Irregular Time Series Embedding
Not on the map. Why?
Abstract (arXiv)
Irregular Multivariate Time Series (IMTS) are common in practice, yet their irregular sampling complicates effective modeling. Existing approaches typically either (i) design specialized architectures that limit the reuse of proven Multivariate Time Series (MTS) models, or (ii) map IMTS onto regular temporal grids through interpolation, which may distort temporal dynamics by introducing artificial values. To address these limitations, we propose a new input-embedding-based approach. We identify that the key bottleneck lies not in the backbone architecture, but in conventional embedding layers that assume uniform sampling. In this work, we introduce QuITE (Query-Based Irregular Time Series Embedding), a simple yet effective plug-and-play embedding module for IMTS. QuITE employs learnable query tokens to aggregate irregular observations through a single self-attention layer, directly producing backbone-compatible latent representations without artificial value generation or architectural modification. Extensive experiments on real-world benchmarks show that QuITE consistently improves MTS models, yielding average relative gains of up to 54.7% in forecasting and 15.8% in classification across diverse datasets and backbone architectures. Code is available at: https://github.com/Meaningfull9502/QuITE.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 34 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
18 of 34 references.
References · 18
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
- 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 241
- 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 234
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
- 2019Set Functions for Time Seriescited by 137
- 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 110
- 2024Is Mamba Effective for Time Series Forecasting?cited by 110
- 2024Pathformer: Multi-scale Transformers with Adaptive Pathways for Time Series Forecastingcited by 102
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 101
- 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
6 more
- 2016Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequencescited by 98
- 2019Interpolation-Prediction Networks for Irregularly Sampled Time Seriescited by 89
- 2024ContiFormer: Continuous-Time Transformer for Irregular Time Series Modelingcited by 61
- 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 54
- 2023PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecastingcited by 20
- 2025Time-IMM: A Dataset and Benchmark for Irregular Multimodal Multivariate Time Seriescited by 16
Built on by
Not cited yet.