mlsanityData to 14 Oct 2026

Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning

arXiv 2202.05750 ↗First posted 11 Feb 2022stat.ML cs.LG math.DScited by 5

Not on the map. Why?

Abstract (arXiv)

The complexity of real-world geophysical systems is often compounded by the fact that the observed measurements depend on hidden variables. These latent variables include unresolved small scales and/or rapidly evolving processes, partially observed couplings, or forcings in coupled systems. This is the case in ocean-atmosphere dynamics, for which unknown interior dynamics can affect surface observations. The identification of computationally-relevant representations of such partially-observed and highly nonlinear systems is thus challenging and often limited to short-term forecast applications. Here, we investigate the physics-constrained learning of implicit dynamical embeddings, leveraging neural ordinary differential equation (NODE) representations. A key objective is to constrain their boundedness, which promotes the generalization of the learned dynamics to arbitrary initial condition. The proposed architecture is implemented within a deep learning framework, and its relevance is demonstrated with respect to state-of-the-art schemes for different case-studies representative of geophysical dynamics.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 49 of its 117 references that are in the map. First posted on arXiv 11 Feb 2022.

Builds on

49 of 117 references.

References · 49

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2016Identity Mappings in Deep Residual Networkscited by 1,965
  4. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  5. 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
  6. 2019Augmented Neural ODEscited by 397
  7. 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 335
  8. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 311
  9. 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
  10. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
  11. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  12. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
37 more
  1. 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 158
  2. 2017Sparse identification of nonlinear dynamics for model predictive control in the low-data limitcited by 140
  3. 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 127
  4. 2020Incorporating Symmetry into Deep Dynamics Models for Improved Generalizationcited by 126
  5. 2016Sequential Neural Models with Stochastic Layerscited by 115
  6. 2020Forecasting Sequential Data using Consistent Koopman Autoencoderscited by 115
  7. 2020Learning Stable Deep Dynamics Modelscited by 111
  8. 2018Latent-space Physics: Towards Learning the Temporal Evolution of Fluid Flowcited by 97
  9. 2019Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systemscited by 96
  10. 2019ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEscited by 84
  11. 2019On Robustness of Neural Ordinary Differential Equationscited by 83
  12. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 74
  13. 2019Optimization for deep learning: theory and algorithmscited by 70
  14. 2019Physics-informed Autoencoders for Lyapunov-stable Fluid Flow Predictioncited by 67
  15. 2022Discovering Governing Equations from Partial Measurements with Deep Delay Autoencoderscited by 58
  16. 2020From Fourier to Koopman: Spectral Methods for Long-term Time Series Predictioncited by 50
  17. 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 44
  18. 2020Learning Variational Data Assimilation Models and Solverscited by 36
  19. 2018Deep Neural Networks for Data-Driven Turbulence Modelscited by 35
  20. 2020Neural Closure Models for Dynamical Systemscited by 22
  21. 2019Episodic Learning with Control Lyapunov Functions for Uncertain Robotic Systemscited by 19
  22. 2019Learning Latent Dynamics for Partially-Observed Chaotic Systemscited by 18
  23. 2016Nonlinear Systems Identification Using Deep Dynamic Neural Networkscited by 14
  24. 2018Data-driven Discovery of Cyber-Physical Systemscited by 13
  25. 2020Constrained Neural Ordinary Differential Equations with Stability Guaranteescited by 13
  26. 2020Physical invariance in neural networks for subgrid-scale scalar flux modelingcited by 13
  27. 2019ANODEV2: A Coupled Neural ODE Evolution Frameworkcited by 12
  28. 2020Variational Deep Learning for the Identification and Reconstruction of Chaotic and Stochastic Dynamical Systems from Noisy and Partial Observationscited by 8
  29. 2020Stability Domains for Quadratic-Bilinear Reduced-Order Modelscited by 8
  30. 2020Analyzing Koopman approaches to physics-informed machine learning for long-term sea-surface temperature forecastingcited by 8
  31. 2017Bilinear residual Neural Network for the identification and forecasting of dynamical systemscited by 5
  32. 2020A Combined Data-driven and Physics-driven Method for Steady Heat Conduction Prediction using Deep Convolutional Neural Networkscited by 5
  33. 2020Joint learning of variational representations and solvers for inverse problems with partially-observed datacited by 4
  34. 2021Learning Runge-Kutta Integration Schemes for ODE Simulation and Identificationcited by 4
  35. 2017Sea Level Anomaly Prediction using Recurrent Neural Networkscited by 3
  36. 2018Sea surface temperature prediction and reconstruction using patch-level neural network representationscited by 3
  37. 2015Learning-based Reduced Order Model Stabilization for Partial Differential Equations: Application to the Coupled Burgers Equationcited by 1

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 1.

5 papers.