mlsanityData to 14 Oct 2026

Mixing It Up: Exploring Mixer Networks for Irregular Multivariate Time Series Forecasting

arXiv 2502.11816 ↗First posted 17 Feb 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Forecasting irregularly sampled multivariate time series with missing values (IMTS) is a fundamental challenge in domains such as healthcare, climate science, and biology. While recent advances in vision and time series forecasting have shown that lightweight MLP-based architectures (e.g., MLP-Mixer, TSMixer) can rival attention-based models in both accuracy and efficiency, their applicability to irregular and sparse time series remains unexplored. In this paper, we propose IMTS-Mixer, a novel architecture that adapts the principles of Mixer models to the IMTS setting. IMTS-Mixer introduces two key components: (1) ISCAM, a channel-wise encoder that transforms irregular observations into fixed-size vectors using simple MLPs, and (2) ConTP, a continuous time decoder that supports forecasting at arbitrary time points. In our experiments on established benchmark datasets we show that our model achieves state-of-the- art performance in both forecasting accuracy and inference time, while using fewer parameters compared to baselines.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 41 references that are in the map. First posted on arXiv 17 Feb 2025.

Builds on

28 of 41 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2018Neural Ordinary Differential Equationscited by 3,779
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2019Root Mean Square Layer Normalizationcited by 1,480
  9. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  10. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
16 more
  1. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  2. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  3. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  4. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 238
  5. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 231
  6. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 139
  7. 2019Set Functions for Time Seriescited by 138
  8. 2021Graph-Guided Network for Irregularly Sampled Multivariate Time Seriescited by 111
  9. 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
  10. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 101
  11. 2023Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Seriescited by 55
  12. 2023Irregular Traffic Time Series Forecasting Based on Asynchronous Spatio-Temporal Graph Convolutional Networkcited by 20
  13. 2024TimeCHEAT: A Channel Harmony Strategy for Irregularly Sampled Multivariate Time Series Analysiscited by 10
  14. 2025Physiome-ODE: A Benchmark for Irregularly Sampled Multivariate Time Series Forecasting Based on Biological ODEscited by 10
  15. 2022Tripletformer for Probabilistic Interpolation of Irregularly sampled Time Seriescited by 6
  16. 2024Probabilistic Forecasting of Irregular Time Series via Conditional Flowscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.