mlsanityData to 7 Oct 2026

Reconstructing a dynamical system and forecasting time series by self-consistent deep learning

arXiv 2108.01862 ↗First posted 4 Aug 2021cs.LG math.DScited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce a self-consistent deep-learning framework which, for a noisy deterministic time series, provides unsupervised filtering, state-space reconstruction, identification of the underlying differential equations and forecasting. Without a priori information on the signal, we embed the time series in a state space, where deterministic structures, i.e. attractors, are revealed. Under the assumption that the evolution of solution trajectories is described by an unknown dynamical system, we filter out stochastic outliers. The embedding function, the solution trajectories and the dynamical systems are constructed using deep neural networks, respectively. By exploiting the differentiability of the neural solution trajectory, the neural dynamical system is defined locally at each time, mitigating the need for propagating gradients through numerical solvers. On a chaotic time series masked by additive Gaussian noise, we demonstrate the filtering ability and the predictive power of the proposed framework.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 15 of its 40 references that are in the map. First posted on arXiv 4 Aug 2021.

Builds on

15 of 40 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2018Neural Ordinary Differential Equationscited by 3,733
  5. 2015Automatic differentiation in machine learning: a surveycited by 846
  6. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 748
  7. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  8. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  9. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
  10. 2020Universal Differential Equations for Scientific Machine Learningcited by 345
  11. 2020Understanding and mitigating gradient pathologies in physics-informed neural networkscited by 134
  12. 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 121
3 more
  1. 2018ResNet with one-neuron hidden layers is a Universal Approximatorcited by 78
  2. 2019Learning Dynamical Systems from Partial Observationscited by 36
  3. 2019Learning Latent Dynamics for Partially-Observed Chaotic Systemscited by 18

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 1.

2 papers.