Deep Time-series Forecasting Needs Kernelized Moment Balancing
Not on the map. Why?
Abstract (arXiv)
Deep time-series forecasting can be formulated as a distribution balancing problem aimed at aligning the distribution of the forecasts and ground truths. According to Imbens' criterion, true distribution balance requires matching the first moments with respect to any balancing function. We demonstrate that existing objectives fail to meet this criterion, as they enforce moment matching only for one or two predefined balancing functions, thus failing to achieve full distribution balance. To address this limitation, we propose direct forecasting with kernelized moment balancing (KMB-DF). Unlike existing objectives, KMB-DF adaptively selects the most informative balancing functions from a reproducing kernel hilbert space (RKHS) to enforce sufficient distribution balancing. We derive a tractable and differentiable objective that enables efficient estimation from empirical samples and seamless integration into gradient-based training pipelines. Extensive experiments across multiple models and datasets show that KMB-DF consistently improves forecasting accuracy and achieves state-of-the-art performance. Code is available at https://anonymous.4open.science/r/KMB-DF-403C.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 58 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
36 of 58 references.
References · 36
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
24 more
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
- 2017Soft-DTW: a Differentiable Loss Function for Time-Seriescited by 265
- 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
- 2020Deep Learning for Time Series Forecasting: Tutorial and Literature Surveycited by 117
- 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 102
- 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
- 2019Shape and Time Distortion Loss for Training Deep Time Series Forecasting Modelscited by 66
- 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 44
- 2024TimeBridge: Non-Stationarity Matters for Long-term Time Series Forecastingcited by 38
- 2025Patch-wise Structural Loss for Time Series Forecastingcited by 34
- 2024Unlocking the Power of LSTM for Long Term Time Series Forecastingcited by 29
- 2025Temporal Query Network for Efficient Multivariate Time Series Forecastingcited by 29
- 2024MarS: a Financial Market Simulation Engine Powered by Generative Foundation Modelcited by 27
- 2025OLinear: A Linear Model for Time Series Forecasting in Orthogonally Transformed Domaincited by 25
- 2025Time-o1: Time-Series Forecasting Needs Transformed Label Alignmentcited by 22
- 2025DistDF: Time-Series Forecasting Needs Joint-Distribution Wasserstein Alignmentcited by 13
- 2021Deep Time Series Forecasting with Shape and Temporal Criteriacited by 10
- 2025Quadratic Direct Forecast for Training Multi-Step Time-Series Forecast Modelscited by 10
- 2023Monotonic Neural Ordinary Differential Equation: Time-series Forecasting for Cumulative Datacited by 9
- 2024Modeling Temporal Dependencies within the Target for Long-Term Time Series Forecastingcited by 6
- 2023TimeSQL: Improving Multivariate Time Series Forecasting with Multi-Scale Patching and Smooth Quadratic Losscited by 5
- 2024Loss Shaping Constraints for Long-Term Time Series Forecastingcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.