mlsanityData to 14 Oct 2026

Deep Probabilistic Koopman: Long-term time-series forecasting under periodic uncertainties

arXiv 2106.06033 ↗First posted 10 Jun 2021cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Probabilistic forecasting of complex phenomena is paramount to various scientific disciplines and applications. Despite the generality and importance of the problem, general mathematical techniques that allow for stable long-term forecasts with calibrated uncertainty measures are lacking. For most time series models, the difficulty of obtaining accurate probabilistic future time step predictions increases with the prediction horizon. In this paper, we introduce a surprisingly simple approach that characterizes time-varying distributions and enables reasonably accurate predictions thousands of timesteps into the future. This technique, which we call Deep Probabilistic Koopman (DPK), is based on recent advances in linear Koopman operator theory, and does not require time stepping for future time predictions. Koopman models also tend to have a small parameter footprint (often less than 10,000 parameters). We demonstrate the long-term forecasting performance of these models on a diversity of domains, including electricity demand forecasting, atmospheric chemistry, and neuroscience. For electricity demand modeling, our domain-agnostic technique outperforms all of 177 domain-specific competitors in the most recent Global Energy Forecasting Competition.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 26 of its 71 references that are in the map. First posted on arXiv 10 Jun 2021.

Builds on

26 of 71 references.

References · 26

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2013Auto-Encoding Variational Bayescited by 4,053
  3. 2018Neural Ordinary Differential Equationscited by 3,779
  4. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  5. 2015Variational Inference with Normalizing Flowscited by 2,170
  6. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  7. 2016Variational Inference: A Review for Statisticianscited by 1,472
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  9. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  10. 2018Conditional Neural Processescited by 426
  11. 2018Neural Processescited by 311
  12. 2021Modern Koopman Theory for Dynamical Systemscited by 276
14 more
  1. 2020Scalable Gradients for Stochastic Differential Equationscited by 271
  2. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  3. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 158
  4. 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
  5. 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
  6. 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 127
  7. 2014A Clockwork RNNcited by 72
  8. 2017Time-lagged autoencoders: Deep learning of slow collective variables for molecular kineticscited by 65
  9. 2018RobustSTL: A Robust Seasonal-Trend Decomposition Algorithm for Long Time Seriescited by 54
  10. 2019Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stabilitycited by 53
  11. 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
  12. 2014Extracting spatial-temporal coherent patterns in large-scale neural recordings using dynamic mode decompositioncited by 49
  13. 2015Compressed Dynamic Mode Decomposition for Background Modelingcited by 17
  14. 2018Quantile Regression for Qualifying Match of GEFCom2017 Probabilistic Load Forecastingcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 0; 2024: 0; 2025: 0; 2026: 3.

4 papers.