mlsanityData to 7 Oct 2026

U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecasting

arXiv 2401.02236 ↗First posted 4 Jan 2024cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers, disrupts feature distributions, and complicates learning data distribution changes. As a result, many existing models struggle to capture the underlying patterns, leading to degraded forecasting performance. In this study, we tackle the challenge of non-stationarity in time series forecasting with our proposed framework called U-Mixer. By combining Unet and Mixer, U-Mixer effectively captures local temporal dependencies between different patches and channels separately to avoid the influence of distribution variations among channels, and merge low- and high-levels features to obtain comprehensive data representations. The key contribution is a novel stationarity correction method, explicitly restoring data distribution by constraining the difference in stationarity between the data before and after model processing to restore the non-stationarity information, while ensuring the temporal dependencies are preserved. Through extensive experiments on various real-world time series datasets, U-Mixer demonstrates its effectiveness and robustness, and achieves 14.5% and 7.7% improvements over state-of-the-art (SOTA) methods.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 4 Jan 2024.

Builds on

11 of 20 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  4. 2020Reformer: The Efficient Transformercited by 1,658
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  6. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  8. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  9. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  10. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  11. 2023MPR-Net:Multi-Scale Pattern Reproduction Guided Universality Time Series Interpretable Forecastingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 1.

7 papers.