mlsanityData to 7 Oct 2026

Deep Time-series Forecasting Needs Kernelized Moment Balancing

arXiv 2602.00717 ↗First posted 31 Jan 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Deep time-series forecasting can be formulated as a distribution balancing problem aimed at aligning the distribution of the forecasts and ground truths. According to Imbens' criterion, true distribution balance requires matching the first moments with respect to any balancing function. We demonstrate that existing objectives fail to meet this criterion, as they enforce moment matching only for one or two predefined balancing functions, thus failing to achieve full distribution balance. To address this limitation, we propose direct forecasting with kernelized moment balancing (KMB-DF). Unlike existing objectives, KMB-DF adaptively selects the most informative balancing functions from a reproducing kernel hilbert space (RKHS) to enforce sufficient distribution balancing. We derive a tractable and differentiable objective that enables efficient estimation from empirical samples and seamless integration into gradient-based training pipelines. Extensive experiments across multiple models and datasets show that KMB-DF consistently improves forecasting accuracy and achieves state-of-the-art performance. Code is available at https://anonymous.4open.science/r/KMB-DF-403C.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 31 Jan 2026.

Builds on

36 of 58 references.

References · 36

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  4. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  5. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  7. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  8. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  10. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  12. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
24 more
  1. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  2. 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 265
  3. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
  4. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
  5. 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
  6. 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 102
  7. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
  8. 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
  9. 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
  10. 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 44
  11. 2024TimeBridge: Non-Stationarity Matters for Long-term Time Series Forecastingcited by 38
  12. 2025Patch-wise Structural Loss for Time Series Forecastingcited by 34
  13. 2024Unlocking the Power of LSTM for Long Term Time Series Forecastingcited by 29
  14. 2025Temporal Query Network for Efficient Multivariate Time Series Forecastingcited by 29
  15. 2024MarS: a Financial Market Simulation Engine Powered by Generative Foundation Modelcited by 27
  16. 2025OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domaincited by 25
  17. 2025Time-o1: Time-Series Forecasting Needs Transformed Label Alignmentcited by 22
  18. 2025DistDF: Time-Series Forecasting Needs Joint-Distribution Wasserstein Alignmentcited by 13
  19. 2021Deep Time Series Forecasting with Shape and Temporal Criteriacited by 10
  20. 2025Quadratic Direct Forecast for Training Multi-Step Time-Series Forecast Modelscited by 10
  21. 2023Monotonic Neural Ordinary Differential Equation: Time-series Forecasting for Cumulative Datacited by 9
  22. 2024Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecastingcited by 6
  23. 2023TimeSQL: Improving Multivariate Time Series Forecasting with Multi-Scale Patching and Smooth Quadratic Losscited by 5
  24. 2024Loss Shaping Constraints for Long-Term Time Series Forecastingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.