mlsanityData to 14 Oct 2026

Adaptive Normalization Mamba with Multi Scale Trend Decomposition and Patch MoE Encoding

arXiv 2512.06929 ↗First posted 7 Dec 2025cs.LG cs.AIcited by 0

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified forecasting architecture that integrates adaptive normalization, multi scale trend extraction, and contextual sequence modeling to address these challenges. AdaMamba begins with an Adaptive Normalization Block that removes non stationary components through multi scale convolutional trend extraction and channel wise recalibration, enabling consistent detrending and variance stabilization. The normalized sequence is then processed by a Context Encoder that combines patch wise embeddings, positional encoding, and a Mamba enhanced Transformer layer with a mixture of experts feed forward module, allowing efficient modeling of both long range dependencies and local temporal dynamics. A lightweight prediction head generates multi horizon forecasts, and a denormalization mechanism reconstructs outputs by reintegrating local trends to ensure robustness under varying temporal conditions. AdaMamba provides strong representational capacity with modular extensibility, supporting deterministic prediction and compatibility with probabilistic extensions. Its design effectively mitigates covariate shift and enhances predictive reliability across heterogeneous datasets. Experimental evaluations demonstrate that AdaMamba's combination of adaptive normalization and expert augmented contextual modeling yields consistent improvements in stability and accuracy over conventional Transformer based baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 12 of its 19 references that are in the map. First posted on arXiv 7 Dec 2025.

Builds on

12 of 19 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba15 Oct

Other references · 11

  1. 2017Squeeze-and-Excitation Networkscited by 4,789
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  8. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  9. 2023GBT: Two-stage transformer framework for non-stationary time series forecastingcited by 8
  10. 2025Non-Stationary Time Series Forecasting Based on Fourier Analysis and Cross Attention Mechanismcited by 2
  11. 2025Rethinking Selectivity in State Space Models: A Minimal Predictive Sufficiency Approachcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaMamba: Adaptive Frequency-Gated Mamba for Long-Term Time Series Forecasting
  2. 2024A Mamba Foundation Model for Time Series Forecasting
  3. 2026DMamba: Decomposition-enhanced Mamba for Time Series Forecasting
  4. 2024FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting
  5. 2024SST: Multi-Scale Hybrid Mamba-Transformer Experts for Time Series Forecasting
  6. 2026UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration
  7. 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics
  8. 2024Is Mamba Effective for Time Series Forecasting?